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Abstract 

The  U.S.  industrial  base  is  revered  by  the  Department  of  Defense  as  a  vital  asset  that  needs  to  be 
managed,  so  it  can  remain  intact  to  support  equipment,  and  even  flourish,  over  an  acquisition 
system’s  entire  life  cycle.  The  U.S.  Army  obligates  billions  of  dollars  of  resources  towards  the 
production  and  sustainment  of  equipment  linked  to  an  industrial  base  that  lacks  in  analysis 
research,  virtual  experimentation,  and  sustainment  risk  analysis.  A  plethora  of  supply  chains 
subject  to  varying  support  philosophies,  supply  and  demand  instability,  and  intellectual  property 
bias  give  rise  to  a  socio-economic  system  that  is  difficult  to  understand,  monitor,  protect,  and 
augment,  using  only  two-dimensional  spreadsheets.  Logistics  Engineering  and  Model-Based 
Systems  Engineering  are  imminent  disciplines  that  have  a  synergy  potential  to  integrate 
sustainment  modeling  and  simulation  into  all  phases  of  an  acquisition  system’s  life  cycle. 
Eacilitating  this  synergy  will  help  give  equal  consideration  to  logistics  and  industrial  base 
ramifications  of  equipment  systems  design  decisions,  ensuring  that  fielded  systems  are 
maintainable  and  ready  for  operations. 

This  research  offers  an  enhanced  situational  awareness  of  the  Tank  Automotive  Research 
Development  and  Engineering  Center  Ground  Vehicle  Robotics  industrial  base.  Opportunities 
exist  to  investigate  industrial  base  attributes  proactively  and  expose  multi-dimensional  patterns, 
using  proven  computer  aided  design,  problem  solving,  and  visual  analytics  methodologies, 
popular  in  the  automotive  and  app  development  industries.  Secondly,  this  research  proposes  to 
conduct  risk  assessments,  using  discrete-event  simulation  tools,  to  leverage  prioritized 
taxonomies  and  relationships  inherent  to  the  Ground  Vehicle  Robotics  sustainment  industrial 
base.  Through  the  successful  deployment  of  SysML,  the  modeling  language  of  systems 
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engineering,  multi-model  orchestration  will  demonstrate  that  the  momentum  of  commercial-off- 
the-shelf  collaboration  technologies  can  interact,  providing  a  strategic  lens  with  which  to  specify, 
analyze,  design,  and  verify  Ground  Vehicle  Robotics  platform  support  strategies.  Fostering  a 
user  interface  that  allows  analysts  to  travel  from  a  macro-level  analysis  space  towards  a  low- 
level  solution  space  is  considered  to  be  of  high-value  to  the  Army.  Since  industry  standard  tools 
already  exist  for  managing  the  chaos  of  distributed  users  constantly  accessing,  analyzing,  and 
modifying  requirements,  behavior,  structure,  and  parametrics,  this  research  proposal  aims  to 
develop  such  a  Model-Based  Systems  Engineering  application  to  analyze  the  ground  vehicle 
robotics  sustainment  industrial  base. 
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Background 

Defense  organizations  employ  many  individuals  whose  missions  revolve  around  ensuring  a 
healthy  industrial  base  (IB)  to  supply  equipment  over  a  prolonged  life  cyele.  These  missions 
should  consist  of  global  situational  awareness  (SA),  resource  management,  systems  monitoring, 
and  proactive  analysis.  The  various  IB  missions  have  been  growing  more  critical  as  military 
equipment  experiences  production  declination  and  materiel  enters  the  sustainment  phase  of  the 
lifecycle.  The  sustainment  phase  entails  low  demand  orders  spread  out  over  long  periods  of 
time  that  can  exceed  fifty  years  (McLeary,  2012;  Office  of  the  Assistant  Secretary  of  the  Army 
Acquisition  Logistics  and  Technology,  2012).  The  inevitable  transition  from  production  to 
sustainment  is  forcing  military  equipment  suppliers  to  think  twice  about  whether  they  should 
suffer  miniscule  sustainment  volumes  or  leave  the  defense  market  altogether  in  search  for  higher 
profit  margins  associated  with  commercial  market  production. 

The  criticality  of  a  healthy  U.S.  IB  was  ultimately  confirmed  by  the  success  of  WWII  and  has 
even  been  deified  by  philosophers,  like  Ayn  Rand  (1957).  The  IB  is  still  revered  today  as 
something  that  needs  to  be  understood,  monitored,  and  protected.  This  is  the  reason  for  the 
plethora  of  regulations,  guidelines,  policies,  and  directives  that  emphasize  the  importance  of 
integrating  IB  considerations  into  systems  design.  For  example.  Army  Regulation  (AR)  700-90 
1-7  says  to: 

Integrate  industrial  base  planning  into  all  phases  of  the  acquisition 
system’s  life  cycle.  Relevant  information  will  be  gathered  and  maintained  in 
order  to  describe  the  current  industrial  base,  identify  critical  sectors  and 
producers,  document  major  shortfalls,  identify  trends,  recommend  corrective 


3 


UNCLASSIFIED 


actions,  and  identify  areas  of  concern  for  further  study  based  on  future  Army 
requirements,  if  needed.  Risk  analysis,  using  industrial  capability  criteria  in  the 
excerpt  from  DODD  5000.60  will  help  make  sound  affordability  decisions. 

In  addition,  MIL-STD-499B  (1994)  recommends  improved  integration  of  systems  requirements 
through:  life  cycle  risk  management,  the  elimination  of  functional  stovepipes,  and  the  tailoring  of 
Commercial-Off-The-Shelf  (COTS)  items. 

A  truly  robust  equipment  solution  involves  not  only  upstream  Design  for  Manufacturing  (DEM) 
practices,  but  involves  ensuring  that  the  manufacturing  infrastructure  will  remain  intact  over  the 
entire  life  cycle.  It  is  important  to  realize  that  manufacturing,  in  and  of  itself,  is  merely  fiction, 
unless  there  is  an  IB  to  foster  it.  Secondly,  actual  supply  chains  are  just  subsets  of  the  “IB” 
connotation,  since  the  IB  includes  untapped  capabilities  and  capacities  as  well.  In  other  words, 
the  IB  takes  in  the  art  of  the  possible,  as  well,  which  delves  into  social  structure,  business 
development,  and  collaboration  potential.  In  a  sense,  the  study  and  preservation  of  the  IB  (the 
parent)  is  even  a  higher  calling  than  just  advancing  the  “state  of  the  art”  in  manufacturing  (the 
child). 

Quite  often,  “people  won’t  make  a  decision  on  manufacturing  something  if  they  don’t  know  their 
supply  is  reliable”  (Lifton,  2012).  This  supply  influence  holds  true  for  whether  or  not  to  conduct 
combat  operations  as  well.  Therefore,  the  outcome  of  supply  and  IB  analysis  affects  national 
security  and  the  United  States’  ability  to  project  forces.  The  IB  consists  of  diverse  businesses 
comprised  of  ever  changing  workforces  and  entrepreneurial  potential  that  could  convert  to 
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technological  breakthroughs  at  any  moment,  making  existing  inventory  obsolete.  The  IB  is 
constrained  by  geographic  and  political  boundaries  (i.e.  Congressional  districts),  dynamic 
litigation,  rights  to  intellectual  property,  and  global  economic  trends.  Like  an  apparition, 
embracing  the  concept  of  the  entire  IB  is  an  overwhelming  domain  to  grasp  and  is  even  more 
challenging  to  analyze.  Yet,  acquiring  SA  of  the  IB  should  preclude  the  design  of  equipment 
support  strategies. 

The  defense  workforce  is  experiencing  a  perfect  storm  of  information  overload,  staff  attrition, 
old-fashioned  office  tools,  and  defense  spending  cuts,  giving  way  to  poor  collaboration  and  low 
productivity  among  IB  analysts  and  strategic  planners  (Bean,  2011,  p.  7).  With  many  Vietnam- 
era  professionals  leaving  the  workforce,  a  new  breed  of  analysts  are  having  to  quickly  learn 
unfamiliar  jargon,  industries,  and  even  resources  that  cut  across  the  Doctrine,  Organization, 
Training,  Materiel,  Leadership  and  Education,  Personnel,  and  Lacilities  (DOTMLPL)  elements 
of  DoD  processes  (e.g.  Joint  Capabilities  Integration  Development  System  [JCIDS]). 
Continually  unearthing  multitudes  of  legacy  Information  Technology  (IT)  systems  and 
perpetually  establishing  networks  of  colleagues  only  induces  more  stagnation  into  a  steep 
learning  curve. 


Camps  of  federal  employees  analyzing  individual  aspects  of  the  IB  are  spread  over  multiple 
hierarchies,  locations,  and  agencies,  each  with  their  own  history,  culture,  and  mission.  Lor 
example,  although  TARDEC  Systems  Engineers  (SEs)  are  beginning  to  work  more  sustainment 
tasks,  the  Integrated  Logistics  Support  Center  (ILSC)  houses  the  core  Logisticians  who  are  more 
known  to  deal  in  Tank  Automotive  Command  (TACOM)  sustainment  concerns,  while  the 
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Product  Support  Managers  lead  the  effort  for  the  Program  Managers  (PMs)  and  are  responsible 
for  sustaining  operations  over  their  equipment’s  life  cycle.  TARDEC  has  acknowledged  a 
workforee  eulture  rejuvenation  and  has  stood  up  the  Eogisties  Engineering  (EE)  philosophy  and 
accompanying  curriculum  to  help  bridge  the  gap  between  the  multiple  groups  and  processes 
influeneing  sustainment.  EE  adds  a  new  dimension  to  the  old  Payload-Proteetion-Performanee 
tradeoff  paradigm  of  Eigure  1  below  (Bochenek,  Benson,  &  Ramdass,  2011,  p.  10). 


Figure  1:  Paradigm  change  to  a  logistics  frame  of  mind 


As  illustrated  in  Eigure  1,  a  new  horizon  of  analysis  is  being  emphasized  by  senior  leadership, 
signifying  that  an  equal  eonsideration  be  given  to  the  logistics  ramifications  of  equipment  design 
deeisions.  The  word  logistics  includes  “planning  and  exeeuting  the  sustainment  of  forees  and 
equipment  in  support  of  military  operations”  (Bean,  personal  eommunication,  November  15, 

201 1).  The  major  foeus  of  sustainment  logistics  is  to  ensure  that  fielded  systems  are 
maintainable  and  ready  for  operations.  Erankly,  Army  Regulation  AR  70-1  formally  states  that 
“supportability  analyses  must  be  eondueted  as  an  integral  part  of  the  systems  engineering  (SE) 
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process  (201 1,  p.  4).  Since  the  IB  is  the  source  that  feeds  the  instruments  of  sustainment  and 
supportability,  from  a  product  stand  point,  the  modeling  and  simulation  (M&S)  of  the  IB  should 
also  be  integral  to  success.  Army  Regulation  AR  70-1  also  states  that  “the  use  of  M&S  should 
be  considered  throughout  all  modifications  and  upgrade  efforts,  as  well  as  measuring 
supportability  and  military  worth”  (2011,  p.  4).  Therefore,  LE  practices  are  being  preached 
throughout  TACOM,  in  an  effort  to  better  understand  the  biggest  culprit  of  life  cycle  costs,  as 
portrayed  in  Eigure  2  below  (Patria,  Bean,  &  McCauley,  2012). 


Life-Cycle  Cost 

◄ - 


<- 

4 - ► 

Materiel  Solution 
Analysis  and 
Technology 
Development  Phase 


- ► 

Engineering  and  Manufacturing 
Development  Phase 


◄ - 

Production  and  DArelopment  Phase 


Sustainment  Phase 


< - ► 

Disposal  Phase 


Figure  2:  Constituents  of  life  cycle  cost 


TARDEC  has  fueled  the  Design  for  Sustainment  (DES)  movement,  also,  by  executing  the 
Human  Capital  (HC)  initiative.  The  HC  initiative  weighed  the  short  and  long  term  skills  needs 
of  TARDEC  with  the  current  and  future  staff,  respectively  (TARDEC  Gl,  2010).  The  lessons 
learned  from  the  HC  initiative  revealed  that  improved  capabilities  in  information  technology 
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(IT),  communication  and  strategic  thinking  are  in  higher  demand  than  just  the  traditional  skill 
sets  of  the  past  (e.g.  mechanical  engineering).  Uncovering  new  M&S  techniques  for  analyzing 
strategic  IB  information  is  a  research  area  that  answers  the  call  for  IB  analysis,  while  fulfilling 
the  gaps  identified  in  the  HC  initiative.  Therefore,  a  collaborative  IT  design  solution  that  solves 
problems  for  the  modem  acquisition  workforce  is  considered  to  be  of  high  value. 

Using  graphics  to  visualize  data  enables  teams  to  recognize  patterns  and  trends  that  would 
normally  be  hidden  from  sight  (Huntley,  1970;  Patria,  2000;  Jarvinen,  Puolamaki,  Siltanen,  & 
Ylikerala,  2009;  Saylor,  Meyer,  Wilmes,  &  Moore,  2011).  More  sophisticated  graphical 
analytics,  like  Dorian  Shainin’s  ISOPLOT,  even  offer  novel  insight  into  the  robustness  of 
measurement  systems  (Steiner,  Mac  Kay,  Ramberg,  2008).  Capatalizing  on  the  perception  and 
cognitive  abilities  of  the  human  eye-mind  system  has  proven  to  offer  leverage,  during  analysis, 
for  centuries.  One  of  the  more  famous  examples  in  history,  developed  by  Pierre  Vernier, 
involves  exploiting  the  capability  of  the  human  eye  to  accurately  judge  colinearity.  Essentially, 
the  Vernier  scale  allows  users  to  repeatedly  pinpoint  a  measurement  on  a  continuous  scale,  with 
attribute-like  precision,  beyond  (ten  times)  the  competence  of  resolution  available  to  the  unaided 
eye.  Spatial  awareness  through  scientific  visualization  also  delves  into  graph  theory  and  the 
study  of  the  space-time  continuum  (Economou,  personal  communication,  June  21,  2012). 
Huntley  (1970)  proposed  that  the  distance  intervals  between  geometric  elements  and  forms  are 
instinctive  to  corresponding  travel  time  intervals,  due  to  the  number  of  nerve  impulses  associated 
with  the  muscular  effort  of  the  eyeball  as  an  on  looker’s  eyes  traverses  along  an  edge,  bailing  to 
represent  systems  as  graphs  and  geodesics,  simply  overlooks  the  prospect  of  concealed 
relationships.  Enter  the  craft  of  visual  analytics:  the  science  of  analytical  reasoning  and  decision 
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making  from  interactive  data  visualizations  (Jarvinen,  Puolamaki,  Siltanen,  &  Ylikerala,  2009). 
The  recent  boom  of  the  “app”  market,  with  its  subtle  incorporation  of  haptics,  also  demonstrates 
the  power  of  amassing  hidden  resources  in  that  intelligent  use  of  data  visualization  enables 
diverse  participation. 


Seeking  new  knowledge  in  the  area  of  IB  analysis  using  visual  analytics,  within  the  context  of  a 
modeling  paradigm  that  encompasses  the  entire  IB  mission,  presents  new  opportunities  for 
experimentation.  The  Army  Capabilities  Integration  Center  (ARCIC)  defines  experimentation 
as: 


an  analytical  activity,  founded  upon  observation  or  experience  derived  from  unbiased  trials 
conducted  under  controlled  conditions  within  a  representative  environment  to  discover 
something  unknown,  to  test  a  hypothesis,  or  demonstrate  some  knowledge  within  a  specific 
context.  Army  experimentation  is  the  conduct  of  experiments  involving  Soldiers  and  leaders 
within  live,  virtual  and  constructive  environments  for  exploring  concepts,  capability 
requirements  and  solutions  across  DOTMLPF  domains,  in  order  to  learn  and  mitigate  risk  for 
current  and  future  forces.  Experimentation  exists  to  gain  knowledge,  in  order  to  reduce  risk 
to  Soldiers  and  investments  and  is  uniquely  suited  for  concept  development.  This  is  due  to 
the  fact  that  experimentation  creates  complex,  uncertain  environments  and  allows  for 
innovation  -  creating  new  knowledge.  Overall,  experimentation  provides  an  integrating 
analytical  infrastructure  for  assessment  across:  1)  Warfighting  functions  and  DOTMEPF,  2) 
academia,  industry,  government,  and  3)  joint,  interagency,  intergovernmental  & 
multinational  domains.  Experimentation  has  value,  because  understanding  is  essential  for 
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decisions  -  for  concepts,  requirements  and  solutions.  In  addition,  experimentation  is  deemed 
valuable  to  the  Army,  due  to  the  understanding  gained  by  learning,  in  that  knowledge  must 
be  developed  in  a  manner  suitable  to  the  problem.  Constructive  analysis  is  suitable  for 
complicated  problems.  Experiments  uniquely  provide  complex  environments  -  an  essential 
complement  to  other  learning  methods.  (Maculley,  2012). 


This  research  proposal  is  the  result  of  a  synthesis  of  three  distinct  requirements  from  three 
interconnected  domains,  as  depicted  in  Eigure  3  below  (Stefanopoulou,  2010). 


Industry:  Army:  TARDEC 


Academia:  LTD:  OEMS  Student:  Garett  Patria 

Figure  3:  Triad  of  dissertation  requirements 


The  following  vision  and  mission  statements  corresponding  to  Eigure  3  embody  the  overarching 
expectations  of  each  domain: 
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TARDEC 

Vision: 

Be  the  recognized  Department  of  Defense  leader  for  ground  systems  and  combat  support  systems 
technology  integration  and  systems-of-systems  engineering  across  the  life  cycle 


Mission: 

Provide  industrial  engineering  support  for  the  U.S.  Industrial  Base  Operations  mission  and  the 
Diminishing  Manufacturing  Sources  and  Material  Shortages  (DMSMS)  initiative.  Provide 
industrial  engineering  expertise  and  experience  to  investigate,  manage,  and  resolve  industrial 
base  issues  related  to  production  and  sustainment  of  military  equipment 


Lawrence  Technological  University  (LTU)  Doctorate  of  Engineering  in  Manufacturing 
Systems  (OEMS) 


Mission: 

Solve  appropriate  dissertation  problems  that  arise  from  the  manufacturing  facility  which  when 
solved  will  have  relevance  to  advancing  the  ‘state  of  the  art’  in  manufacturing.  The  result  may 
be  a  new  manufacturing  related  device,  process,  system,  or  software  for  which  high-level 
scholarship  engineering  expertise  and  ingenuity  are  required  to  find  the  solutions 
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Garett  Patria 


Mission: 

Formulate  a  research  area  that  leverages  my  passion,  unique  skills,  and  current  opportunities  and 

resources 

Expanding  on  each  of  the  three  aforementioned  domains,  preliminary  research  was  conducted 
between  2010  and  2012  to  gather  actual  results  (e.g.  documented  systems  attributes.  Army 
efforts  consuming  tangible  resources)  that  exemplify  and  expand  on  the  priorities  of  the  three 
domains  of  Figure  3.  A  storyboard  of  the  expanded  domains  was  maintained  to  map  out  the  flow 
of  interconnected  themes  and  is  shown  below  in  Figure  4. 


Figure  4:  Storyboard  used  for  DBMS  proposal  strategic  planning 
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A  digital  representation  of  the  aetual  storyboard  was  also  ereated  to  summarize  the  findings  of 
the  domain  pre -research,  along  with  a  narrated,  three-part  video  explaining  each  section  that  was 
used  to  brief  targeted  DBMS  academic  and  industrial  advisors  (see  Figure  5). 


A  concise  list  outlining  each  numbered  element  of  the  premeditated  storyboard  is  shown  below: 

Red  Section  or  “Student”  Domain: 

1 .  DBMS  call  to  “create  new  knowledge”  linked  with  my  mission  at  TARDEC 

2.  traits  and  behaviors  that  make  me  a  doctoral  candidate 

3.  subjects  I  want  to  explore  in  the  future 

4.  a  list  of  results-to-effort  considerations 
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5.  organizational  structures  showing  how  manufacturing  systems  falls  under  the  Logistics 
realm  (in  terms  of  Acquisition,  Logistics,  and  Technology);  but,  in  terms  of  the  Systems, 
Planning,  Research,  Development,  and  Engineering  (SPRDE)  career  field,  manufacturing 
systems  is  considered  an  SE  discipline.  SE  is  the  discipline  under  which  I  was  hired 

Yellow  Section  or  “Employer”  Domain: 

6.  the  top  three  TARDEC  competencies  needed  within  the  next  five  years  (CY2010  - 
CY2015)  were  found  to  be:  Visionary,  Strategic  Thinking,  and  Systemic  Thinking 
(TARDEC  Gl,  2010) 

7.  the  top  three  TARDEC  competencies  needed  within  the  six  months  spanning  from  Jun  2010 
to  Dec  2010  were  found  to  be:  Proactive,  Communication,  and  Relationship  Building 
(TARDEC  Gl,  2010) 

8.  the  top  three  CY2010  contributors  to  TARDEC  success  were  found  to  be:  Customer  Locus, 
Technical  Proficiency,  and  Problem  Solving  (TARDEC  Gl,  2010) 

9.  the  second  goal  of  the  2009  Department  of  the  Army  (DA)  Materiel  Enterprise 
Transformation  Plan  (METP)  is  to  ensure  a  viable  Industrial  Base  (Department  of  the  Army, 
2009) 

10.  the  TARDEC  Director’s  call  to  reduce  unintended  consequences  through  a  paradigm  shift 
from  a  Space,  Weight,  Power,  and  Cooling  (SWaP+C)  mind-set  to  a  Space,  Weight,  Power, 
Cooling,  and  Logistics  (SWaP-i-C-i-L)  mind-set,  where  Logistics  represents  a  third 
dimension,  introducing  depth  to  the  old  SWaP-i-C  2D  model.  Logistics  encompasses  the 
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Commonality,  Durability,  Transportability,  Supportability/Maintainability,  and 
Producibility  disciplines  (Bochenek,  Benson,  &  Ramdass,  2011,  p.  10) 

11.  the  Office  of  Management  and  Budget  (0MB)  nomenclature  and  funding  (e.g.  6.1,  6.2,  6.3) 
distinctions  explaining  Basic  Research  (i.e.  6.1),  Applied  Research  (i.e.  6.2)  and 
Advanced  Technology  Development  (6.3  funding),  which  are  transcribed  below  (0MB, 
2012;  Rand  Corporation,  2012;  Sargent,  2012;  Coyle,  2011,  p.l7  ): 

Basic  Research: 

Systematic  study  directed  toward  greater  knowledge  or  understanding  of  the  fundamental 
aspects  of  phenomena  and  of  observable  facts  without  specific  applications  toward 
processes  or  products  in  mind 

Applied  Research: 

Systematic  study  to  gain  knowledge  or  understanding  necessary  to  determine  the  means  by 
which  a  recognized  and  specific  need  may  be  met 

Advanced  Technology  Development: 

Includes  all  efforts  that  have  moved  into  the  development  and  integration  of  hardware  for 
field  experiments  and  tests 

12.  a  hierarchal  depiction  of  the  different  levels  of  research  visibility  (e.g.  National  Science 
Foundation  (NSF)  vs.  International  Council  of  Systems  Engineers  (INCOSE))  and 
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organizational  support  that  should  be  considered  when  conducting  research  (Ali,  personal 
communication,  October  2010) 

13.  a  preliminary  list  of  hot  topics  observed  within  TARDEC  -  the  beginning  stages  of  a  Pugh 
Analysis  on  DEMS  dissertation  proposal  titles 

14.  an  Acquisition,  Eogistics,  and  Technology  (AE&T)  Online  article  announcing  the  AE&T 
2010  M&S  Award  -  this  storyboard  element  shows  the  unique  opportunities  associated  with 
particular  areas  of  research 

15.  a  list  explaining  the  considerations  of  choosing  to  conduct  DA  research,  as  opposed  to 
private  research  not  affiliated  with  the  DA  nor  any  of  its  requirements  and  restrictions  (part 
of  the  aforementioned  Pugh  Analysis) 

Green  Section  or  “School”  Domain: 

16.  a  commonality  matrix  identifying  overlapping  key  words  between  the  requirements  of  the 
aforementioned  domains  of:  my  employer,  my  school,  and  myself  -  this  matrix  was 
considered  when  constructing  the  title  of  this  dissertation  proposal 

17.  the  initial  vision,  mission,  and  strategic  goals  to  generate  and  formally  document  a  DEMS 
dissertation  proposal  -  treating  the  DEMS  dissertation  like  a  business  entity,  in  and  of  itself 
(Shenkus  &  Sloss,  personal  communication.  May  12,  2010) 

18.  the  initial  matrix  of  deadlines  required  to  transform  the  DEMS  dissertation  strategic 
objectives  into  goals  (Taraman,  personal  communication,  June  1,  2010) 

19.  the  initial  Gantt  Chart  used  to  track  DEMS  goals  and  progress 
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20.  a  Concept  Diagram  depicting  the  relationship  of  prevalent  dissertation  topics  as  a 
function  of  literature  search  workload  (time)  -  a  consideration  pertaining  to  Lloyd 
Alexander’s  theory  that  suggests  we  learn  more  by  looking  for  the  answer  to  a  question  and 
not  finding  it  than  we  do  from  learning  the  answer  (Dr.  Jeff  Abell,  personal 
communication,  2010) 

21.  a  characterization  of  a  historical  sample  of  DBMS  dissertations  depicting  data  content  as  a 
function  of  total  length  (as  measured  in  pages) 

22.  a  synopsis  of  potential  divergence  between  potential  research  areas,  mission  alignment,  and 
perceived  deadlines 

Other  various  chronicles  leading  up  to  this  research  proposal  are  included  in  Appendix  B.  The 
chronicles  offer  additional  transparency  into  the  development  of  the  proposed  topic  for  doctoral 
study. 

In  terms  of  how  the  DA  is  formally  planning  for  the  future  and  what  technologies  TARDEC 
should  be  working  on,  ARCIC  provided  insight,  during  a  brief  to  TARDEC  on  25  Oct  2012, 
emphasizing  the  1)  emergence  of  M&S  applications  and  2)  experimentation  opportunities. 
ARCIC  feels  TARDEC  should  integrate  more  developed  models  into  everyday  practice,  in  order 
to  sustain  the  organization  of  the  future. 
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Problem  Statement 

TARDEC  does  not  have  a  holistic  model  that  identifies  and  integrates  the  requirements, 
behavior,  structure,  and  parametrics  of  the  Ground  Vehicle  Robotics  sustainment  industrial  base. 


Literature  Search 

This  dissertation  proposal  touches  on  five  disciplines,  each  with  their  own  league  of  scholarly 
publications  and  host  of  gatherings  that  incubate  research  findings.  The  five  disciplines  include: 
1)3  Dimensional  (3D)  visualization,  2)  military  sustainment,  3)  supply  chain  management,  4) 
systems  engineering,  and  5)  robotics.  The  robotics  discipline  was  included  in  the  literature 
search,  since  it  serves  as  the  proposed  platform  of  focus  for  this  research.  Robotics  is  well 
known  for  its  out-of-the-box  culture  of  researchers  who  often  motivate  technology  and  generate 
fast  prototypes  on  lean  budgets.  Specifically,  robotics  platforms  typically  deal  with  smaller  Bills 
of  Materials  (BOMs)  and  supply  chains,  so  more  emphasis  can  be  placed  on  the  theme  of  the 
research,  as  opposed  to  the  superfluous  part  counts  associated  with  stereotypical  heavy  combat 
equipment,  for  example.  Einally,  one  of  the  primary  depots  for  robotics  overhaul  is  considered 
local,  creating  a  unique  opportunity  to  explore  a  significant  aspect  of  the  platform’s  supply  chain 
without  expending  scarce  travel  resources. 

The  literature  reviewed  in  this  proposal  was  chosen  based  on  how  it  applied  to  the  research 
vision  of  the  author.  During  the  literature  search,  key  aspects  of  the  literature  were  recorded  in  a 
comprehensive,  bibliometric  model  that  also  served  as  a  repository,  or  e-diary,  to  house  notes 
and  subsequent  hyperlinks  to  information  offering  more  granularity  (see  Eigure  6). 
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Figure  6:  Bibliometric  interface 


Note  how  Figure  6  exhibits  some  of  the  key  information  of  eaeh  pieee  of  literature,  sueh  as: 
author,  title,  doeument  type,  date,  society,  location,  and  number  of  pages.  Since  the  root 
interface  of  the  bibliometric  model  is  a  pivot  table,  the  resultant  pivot  charts  provide  a  visual 
gage  to  communicate  the  breadth  and  depth  of  the  literature  search. 

An  important  first  step  of  the  literature  search  was  to  simply  identify  the  various  professional 
organizations  (societies,  conferences,  etc.)  and  publications  (journals,  dissertations,  etc.)  that 
pertain  to  the  five  disciplines  (i.e.  3D  visualization,  military  sustainment,  supply  chain 
management,  systems  engineering,  and  robotics).  Over  one  hundred  organizations/publications 
were  considered,  during  the  literature  search,  in  a  strategic  effort  to  capture  more  breadth  than 
depth.  Literature  breadth  was  considered  primary  and  depth  considered  secondary,  due  to:  1)  the 
multi-domain  philosophy  advocated  by  the  systems  engineering  discipline  and  2)  the  author’s 
supplementary  depth  of  field  experience  in  the  IB  analysis  domain. 

In  general,  the  organizations  and  publications  have  a  reputation  that  ranges  across  427  years,  the 
oldest  being  Cambridge  University  Press.  The  Thomson  Reuters™  2-year  impact  factors  for 
some  of  the  publications  were  superimposed  over  a  Pareto  Chart  showing  when  the  respective 
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organizations  and  publications  were  founded  (see  Figure  7).  For  the  full  list  of  organizations  and 
publications  explored  in  the  pre-research,  please  see  Appendix  A. 


Figure  7:  Legacy  and  relative  impact  factors  of  select  organizations  and  publications 


Out  of  the  101  organizations  and  publieations  discovered,  129  scholarly  articles  were  targeted 
and  categorized,  by  type,  whose  distribution  is  depicted  below  in  Figure  8). 
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Figure  8:  Categorization  of  scholarly  literature 


Another  output  of  the  bibliometric  model  takes  the  type  of  publication  targeted  and  overlays  an 
alphabetical  listing  of  the  authors,  as  well  as  the  number  of  publications  targeted  per  author  (see 
Figure  9). 
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Breadth  and  Depth  of  Literature  Search 


Y.  Peng  j 
William  H.  Press  j 
Thomas  J.  Edwards  | 
T.  Finin  j 
Shahram  Sarkani  j 
Sanjay  Jain  j 
S.  Dowlatshahi 
Robert  B.  Handfield  j 
Randy  Williams  j 
Qihua  Tian  j 
PaulKimmel  j 
N/A  i 
MIBP  j 
Markka  Hentula  | 
Marc  L.  Robbins  j 
Louis  R.  Moore  j 
Kevin  Lyons  j 
Karen  Maculley  j 
Juha-Matti  Lehtonen  | 
John  Dew 

James  L.  Patterson  | 
J.  Current  j 
Gustave  F.  Perna  j 
Frederick  P.  Samson  j 
Douglas  R.  Miller  j 
Daniel  McDowell  | 
Christopher  Thompson 
Brian  P.  Flannery  | 
Ashish  Agarwal  j 
Alan  Woody  j 


I  (blank) 

I  website 
I  report 
I  presentation 
I  paper 
I  journal 
I  eBook 
I  document 
I  dissertation 
I  book 
I  article 


1  2 
Number  of  Publications  Explored  in  this  Proposal 


Figure  9:  Literature  type  by  author 


The  visual  analytic  output  of  the  bibliometric  model,  like  the  analytic  shown  in  Figure  9,  gives 
research  critics  a  set  of  gages  to  judge  how  well  the  literature  was  scoured.  In  the  case  of 
multiple  authors  for  one  piece  of  literature,  options  exist  in  the  interactive  bibliometric  model  to 
display  one  publication  per  author-team,  if  desired.  Many  other  visual  analytic  outputs  are 
possible,  due  to  the  COTS  availability  and  familiarity  of  MS  Office  pivot  table  and  pivot  chart 
options. 
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Literature  Review 

The  first  three  papers  of  the  literature  search  chosen  for  review  involve  literature  surveys 
themselves.  Appelqvist,  Lehtonen,  &  Kokkonen  gathered  bibliometrics  of  their  own  in  that  they 
examined  15  journals  between  1997  and  2001  to  classify  various  supply  chain  modeling  papers 
in  a  framework,  in  order  to  match  the  modeling  approach  with  the  decision-making  situation. 

The  classifications  in  the  decision-making  framework  included:  1)  Continuous  Improvement,  2) 
Re-engineering,  3)  Design  for  Logistics  (DEL),  and  4)  Breakthrough,  depending  on  whether  the 
supply  chain,  and  product  being  supplied,  was  new  or  existing. 

Articles  which  had  a  simulation  approach  were  tallied  against  articles  that  had  an  optimization 
approach,  noting  the  distinctions  of  both.  The  proportion  of  simulation  versus  optimization 
papers  was  considered  balanced  at  46  papers  versus  39  papers,  respectively.  The  European 
Journal  of  Operational  Research  (EJOR)  had  more  papers  than  any  of  the  other  83  papers  (out  of 
15  journals  surveyed)  that  matched  the  authors’  survey  criteria:  1)  the  paper  must  relate  to  a 
physical  product  and  its  supply  chain  in  a  business  environment,  2)  the  paper  must  have  a 
modeling  approach,  and  3)  the  paper  must  exemplify  an  actual  case  application  utilizing  real 
data.  Considering  all  the  papers  surveyed,  continuous  improvement  research  was  the  most 
abundant,  compared  to  the  other  three  framework  classifications.  Although  difficult  to 
determine,  the  largest  single  industries  covered  by  the  sampled  papers  were  the  electronics,  food, 
and  automotive  industries.  Other  categorical  splits  observed  were:  38  cases  utilized  discrete  part 
manufacturing  versus  21  for  process  manufacturing  (e.g.  undifferentiated  product). 

Appelqvist,  Lehtonen,  &  Kokkonen  found  that  most  research  (i.e.  80  out  of  83  papers)  was 
conducted  within  the  classifications  involving  existing  product  (i.e.  continuous  improvement  and 
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re-engineering),  as  opposed  to  classification  involving  new  product  (DEL  and  breakthrough). 
Also,  models  were  used  more  for  one-time  analysis,  as  opposed  to  continuous  decision  support. 
Einally,  using  a  benchmark  case  study  of  a  Patria  Etd  (a  Einnish  defense  company)  aerospace 
structure  development  project,  the  authors  observed  that  the  3D  characteristic  of  simulation 
offered  the  most  convincing  aspect  of  analysis.  Eurthermore,  simulation  models  that  interact 
within  an  overarching  information  technology  (IT)  infrastructure  and  follow  the  product  life 
cycle  from  concept  to  full-scale  production  are  considered  as  obligatory. 


Terzi  &  Cavalieri  (2004)  surveyed  more  than  80  articles,  coined  under  the  mantra  of  supply 
chain  management,  that  deal  in  simulation  and  the  industrial  collaborative  environment. 
Initiatives  that  adopt  an  external  perspective  on  the  design  and  implementation  of  new  supply 
chain  management  strategies  were  reviewed.  The  authors  determined  that  simulation’s  main 
property,  what-if  analysis,  plays  an  important  role  in  analyzing  complexity  problems  associated 
with  logistics  networks.  Among  other  quantitative  methods  like  Advanced  Planning  and 
Scheduling  systems  (APS),  Supply  Chain  Operations  Reference  (SCOR)  modeling,  linear 
programming,  and  genetic  algorithms,  simulation  knowledge  is  one  of  the  most  important 
competencies  for  many  different  processes,  including  business,  marketing,  and  manufacturing. 

The  coordination  practices  of  running  multiple  simulations  started  around  1970  and  were 
computationally  divided  into  two  general  categories:  analytic  simulation  (quantitative  only)  or 
distributed  virtual  environment  (extensive  use  of  visual  analytics).  It  is  important  to  note  that  the 
visualization  capability  of  simulation  was  considered  its  own  category,  until  the  two  categories 
merged  into  what  is  known  now  as  Parallel  and  Distributed  Simulation  (PDS)  paradigms,  which 
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suggests  that  supply  chain  M&S  can  be  a  single  model  producing  all  nodes,  or  many  parallel 
models  cooperating  in  one  simulation.  Two  major  types  of  PDS  include  Distributed  Simulation 
(DS)  and  Parallel  discrete-event  simulation  (PS),  depending  on  whether  there  are  multiple 
computers  geographically  distributed  or  not.  PDS,  in  general,  is  considered  to  be  a  worthy 
consideration,  due  to  the  following  benefits:  1)  simulation  time  reduction  (segmentation 
principle),  2)  PDS  can  accommodate  the  reality  of  geographically  distributed  human  resources, 

3)  PDS  has  the  capability  to  have  each  simulation  model  run  in  their  native  language,  4) 
reliability  improvement  through  multi-node  redundancy. 

The  PDS  framework  is  divided  into  three  schools  of  thought:  1)  a  network  structure  where  all  the 
distributed  nodes  continually  interact  with  each  other,  2)  a  centralized  structure  where  dedicated 
software  orchestrates  messages  from  the  distributed  nodes  and  3)  High  Level  Architecture 
(HLA)  which  is  based  on  ten  ground  rules  for  creating  and  managing  the  simulation.  HLA  was 
developed  by  the  DoD  and  is  considered  to  be  the  most  known  PDS  framework  (Terzi  & 
Cavalieri,  2004).  HLA  involves  an  interface  specification  (i.e.  IEEE  1516)  and  overarching 
software  referred  to  as  a  Run  Time  Infrastructure  (RTI).  Terzi  and  Cavalieri  claim  HLA  helps 
mitigate  the  risk  of  outside  enterprises  hoarding  M&S  data,  which  is  a  typical  roadblock  to 
harmonizing  distributed  systems.  Einally,  the  authors  tallied  each  of  the  80  papers  surveyed  by 
various  scope  and  objective  subcategories.  A  key  observation  of  the  survey  was  that  the  local 
simulation  paradigm  is  still  the  most  applied  approach  and  typically  involves  supply  chain  design 
and  strategic  model  verification  through  expert  reviews.  The  paper  concluded,  by  suggesting 
future  trends  in  supply  chain  simulation,  including  a  need  for  more  work  involving  PDS 
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applications.  Two  PDS  projects  discussed  were  the  Web  Integrated  Logistics  Designer  (WILD) 
and  the  Osim  project. 

Kleijnen  (2005)  surveyed  literature  pertaining  to  four  different  types  of  supply  chain 
management  (SCM)  simulation  and  discussed  their  methodological  issues,  while  emphasizing 
the  role  of  statistical  methods  for  the  design  of  experiments  (DOE).  The  four  types  of  SCM 
simulation  included:  1)  spreadsheet  simulation  (i.e.  corporate  modeling),  2)  system  dynamics 
(SD),  3)  DES,  and  4)  business  games.  Kleijnen  defined  simulation  as  an  experimental  method 
where  analysts  experiment  with  various  factors  and  model  structures.  The  characteristics  of 
SCM  simulation  models  include:  1)  they  are  quantitative,  2)  they  are  transient,  and  3)  they  are 
not  solved  by  stand-alone  mathematical  analysis.  The  proper  simulation  type  is  determined  by 
the  type  of  “what-if’  input  in  which  the  tradeoffs  are:  1)  validation  and  verification,  2) 
sensitivity,  3)  optimization,  and  4)  risk  and  robustness  analysis.  Kleijnen  emphasized  that 
simulation  is  important,  because  it  supports  the  quantification  of  benefits  resulting  from  SCM 
and,  thereby,  guides  decisions  through  multiple  zoom  levels  (i.e.  strategic,  operational).  The 
educational  value  and  analytical  derivation  power  of  various  connotations  of  human  behavior 
modeling  (i.e.  gaming)  was  discussed  as  well.  Kleijnen  found  that  strategic  and  operational 
game  modeling  is  much  more  difficult  than  simulating  technological  and  economic  processes. 
DOE  models  treat  systems  as  black  boxes,  unlike  most  simulation  models  (exceptions  include 
perturbation  and  score  function  methods).  One  of  the  noted  phenomena,  deemed  a  bullwhip 
effect  within  the  SD  portion  of  the  survey,  was  the  amplification  of  demand  fluctuation,  due  to 
varying  strategies  in  how  deviations  between  actual  and  target  inventories  were  managed.  SD 
was  deemed  to  view  companies  as  systems  with  six  varieties  of  input  and  output  flows:  1) 


26 


UNCLASSIFIED 


materials,  2)  goods,  3)  personnel,  4)  money,  5)  orders,  and  6)  information.  On  the  other  hand, 
the  DES  portion  of  the  survey  exposed  that  DES  has  two  distinguishing  characteristics:  1)  it 
represents  individual  events  and  2)  it  allows  for  stochastic  inputs  and  outputs.  A  strategic  DES 
case  study  was  conferred  that  consisted  of  three  simulation  models  representing  three  alternative 
supply  chain  designs.  In  the  case  study,  the  most  important  factors  were  screened  by  sequential 
bifurcation  (SB),  with  replication,  and  assessed  for  how  well  the  factors  can  be  influenced  by 
management.  The  SB  enabled  a  focus  on  49  potentially  important  factors,  down  from  92  (a 
reduction  of  almost  47%).  A  DOE  was  conducted,  leveraging  central  composite  design  and  latin 
hypercube  sampling  (EHS),  along  with  a  hypothetical  Taguchi  optimization  demonstration.  The 
bootstrapping  method  of  confidence  interval  creation  was  then  exemplified  to  properly  deal  with 
the  nonlinear  input  functions  of  the  simulation  outputs.  Overall,  the  experiment  revealed  that 
one  of  the  factors  (e.g.  demand  for  product  1)  accounts  for  90%  of  the  total  demand  of  the  supply 
chain.  Einally,  some  of  the  differences  were  discussed  between  optimizing  for  mean,  as  opposed 
to  variance,  where  the  author  expressed  that  it  is  more  important  to  find  robust  solutions  than  the 
optimal  solution. 

Tolone  (2000)  presented  that  small  reductions  in  inventory,  facilitated  by  Virtual  Situation  Room 
(VSR)  technology  incorporating  feature  rich  protocols,  could  result  in  billions  of  dollars  of 
savings,  since  approximately  $1  trillion  USD  is  tied  up  in  inventory,  globally.  The  structure  of 
the  paper  was  presented  in  three  parts:  1)  an  overview  of  common  manufacturing  practices,  2)  an 
explanation  of  the  VSR  collaboration  technology  solution,  and  3)  a  VSR  demo.  Contested  issues 
still  relevant  today,  like  lean  contracting  and  technical  data  package  (TDP)  definition  were 
covered. 
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VSR  research  began  in  1998  and  is  a  result  of  the  mission  of  the  Extended- Enterprise  Coalition 
for  Integrated  Collaborative  Manufacturing  Systems  (EECOMS)  which  is  to  research,  develop, 
and  demonstrate  technologies  to  enable  the  integration  of  manufacturing  applications  in  multi¬ 
company  supply  chain  planning  and  execution  environments.  In  a  related  effort,  the  Department 
of  Commerce  (DoC),  National  Institute  of  Standards  and  Technology  (NIST),  and  Advanced 
Technology  Program  (ATP)  joined  forces  to  create  the  industry-sponsored  Consortium  for 
Intelligent  Integrated  Manufacturing  Planning-Execution  (CIIMPEEX)  as  an  initiative  for 
advancing  data  sharing  (Peng  et  ah,  1999).  Tolone  stressed  the  importance  of,  both, 
asynchronous  and  real-time  collaboration,  as  well  as  why  no  single  supply  chain  model  fits  all 
manufacturing  processes.  The  Supply  Chain  Operations  Reference  (SCOR)  model  proposed  by 
AMR  Research,  Inc.,  for  example,  provided  a  visual  analytic  that  depicted  the  planning, 
sourcing,  making,  and  delivering  activities.  On  the  other  hand,  the  Collaborative  Planning, 
Porecasting,  and  Replenishment  (CPPR)  model  proposed  by  the  Voluntary  Inter- Industry 
Commerce  Standards  Organization  (VIICSO)  based  on  Benchmarking  Partners,  Inc. 
Collaborative  Porecasting  and  Replenishment  (CPAR)  work  with  Wal-Mart,  stressed  the 
importance  of  strategic  planning  sharing  among  large  trading  partners.  Similarly,  the 
Collaborative  High  Speed  Adaptive  Supply  Chain  Model  (CHASM)  suggests  strategic  supply 
and  demand  planning  sharing  amongst  partners,  but  puts  more  emphasis  on  lightweight 
solutions,  involving  more  human  intervention,  for  situations  that  fall  outside  initial,  strategic 
boundaries.  The  VSR  vision  focuses  on  providing  a  primitive  connectivity  to  the  human 
intervention  outlet,  by  offering  more  of  a  knowledge  workflow  domain,  through  decentralized 
data  and  knowledge  fragmentation,  with  various  alarm  conditions  that  provide  a  greater  SA. 
Respecting  the  need  for  situational  knowledge,  a  series  of  portals  were  proposed,  including:  1) 
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Enterprise  Information  Portals  (EIP),  2)  Enterprise  Collaborative  portals  (ECP),  3)  Enterprise 
Expertise  Portals  (EEP),  and  4)  Enterprise  Knowledge  Portals  (EKP).  These  portals,  showcasing 
entities,  termed  zones:  infospheres,  teamrooms,  commonpoints,  virtual  offices,  and  media  spaces 
are  comparable  to  the  Eacebook  chats,  Skype,  SharePoint,  and  Google  Docs  tools  of  today. 

Jain  and  Eeong  (2005)  proposed  a  simulation  model  using  Arena  to  determine  the  readiness  of  a 
supply  chain  providing  equipment  to  a  defense  contractor.  By  depicting  a  virtual  operation,  the 
paper  describes  the  reduction  of  perceived  risk  of  sourcing  from  Small  and  Medium  Enterprises 
(SMEs).  The  main  steps  presented  were  the  evaluation  of  spiked  demand  scenarios, 
identification  of  limitations  to  supply,  validation  of  supply  chain  configuration  enhancements, 
along  with  corresponding  results.  Interestingly,  the  aforementioned  SCOR  model  (Tolone,  2000) 
is  another  way  to  specify  the  project.  Also,  it  was  noted  that  SMEs  have  not  enjoyed  their  fair 
share  of  supply  chain  simulation  research.  Through  ten  nodes,  four  stages,  three  Tier  II 
suppliers,  five  Tier  I  suppliers,  the  SME  itself,  and  the  defense  contractor,  the  model  simulates 
normal  operations,  surges  (two  times  normal  volume),  and  mobilization  (four  times  normal 
volume)  scenarios.  A  questionnaire  (with  little  response)  also  accompanied  the  study,  in  an 
attempt  to  satisfy  two  objectives:  1)  simulation  and  2)  value  stream  mapping  (VSM).  The 
simulation  was  presented  in  the  following  order:  1)  analysis  of  modeled  phenomena,  2) 
formatting  of  the  data,  3)  the  reading  of  the  data  into  the  simulation,  4)  configuration  of  the 
simulation  model,  and  5)  execution  of  the  simulation  runs.  The  importance  of  an  M&S  solution 
exhibiting  a  good  graphical  user  interface  (GUI)  was  underscored,  along  with  the  capability  to 
interface  with  popular  tools,  like  MS  Excel.  The  output  of  the  simulation  tracked  bottlenecks 
and  capacities,  while  ensuring  no  back  log  orders  at  the  SME.  Investment  in  inventories  ranged 
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from  $2.33M  to  $3.62M  USD  to  handle  the  surge  volumes  and  a  $5.62M  investment  was 
simulated  to  accommodate  the  mobilized  volumes. 

The  lessons  learned  from  the  study  included:  1)  committing  enough  resources  to  gather  data  in  a 
timely  fashion,  2)  using  the  right  level  of  model  abstraction,  3)  focusing  on  only  the  critical  data, 
4)  establishing  the  key  output  metrics  up  front,  5)  building  internal  cross-checks  to  ensure  the 
model  is  behaving  logically,  6)  validating  the  model  with  expert  reviews,  and  7)  utilizing 
visualization  techniques  for  improved  understanding. 

Kang  and  McDonald  (2010)  used  Microsoft  Excel  spreadsheets  and  Arena  models  to  generate 
life  cycle  cost  and  operational  availability  (Ao)  responses,  after  varying  component  reliabilities, 
inventory  of  spares,  operational  tempo  (Op  Tempo),  and  repair  turnaround  times.  The  paper 
serves  as  a  practical  execution  of  COTS  analysis  tools.  Regression  Trees,  described  as  “more 
human-readable”,  were  used  to  depict  the  threshold  of  where  inner  leaf,  response  variability 
diminishes  and  leaf-to-leaf  response  variability  increases.  The  resulting  DOE  confirmed  that  Aq 
is  an  influential  metric  that  correlates  to  life  cycle  cost  and  depends  on  repair  part  availability. 
However,  the  analysis  assumes  that  a  fruitful  supply  chain  (and  a  parent  IB)  is  a  given. 

Jarvinen,  Puolamaki,  Siltanen,  &  Ylikerala  (2009)  reported  the  findings  of  a  joint  visual  analytics 
project,  noting  that  the  topic  of  information  visualization  has  been  an  active  research  area  since 
1990.  Executed  in  2008,  between  the  Technical  Research  Centre  of  Einland  (VTT),  the  Helsinki 
University  of  Technology  (TKK),  and  the  Helsinki  Institute  of  Information  Technology  (HUT), 
the  report  introduced  the  concept  and  the  state-of-the-art  in  the  market.  In  addition,  a 
demonstration  tool  developed  in  the  project  illustrated  the  concept.  Einally,  the  report  outlined 
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roadmaps  for  industrial  and  consumer  applications.  The  building  blocks  of  visual  analytics  were 
presented  as:  1)  information  visualization,  2)  data  mining,  3)  analytical  reasoning,  and  4) 
integrating  data  sources.  The  concept  is  based  on  how  visualizations  increase  human  cognitive 
resources,  especially  when  viewed  through  different  lenses  or  experience  domains.  Some  of  the 
aspects  of  human  perception  analyzed  in  the  study  include:  processing  visual  symbols,  human 
perceptual  processing,  human  eye  properties,  visual  attention,  the  Gestalt  laws  of  pattern 
perception,  visual  objects  perception,  perception  of  distance  and  size,  and  visual  interaction. 
Interactive  visualizations  that  are  characterized  by  a  feedback  loop  can  be  further  divided  into 
three  phases:  1)  data  manipulation,  2)  view  refinement  and  navigation  (exploration 
and  navigation),  and  3)  problem  solving.  On  the  other  hand,  visual  grammars  like  Systems 
Modeling  Language  (SysML),  are  considered  to  be  applications  of  Gestalt  laws.  Specialized 
software  available  in  the  market  was  presented  to  reside  in  the  following  domains:  1)  office 
tools,  2)  business  intelligence  tools,  3)  statistical  and  mathematical  tools,  4)  visualization-related 
libraries  and  software  packages,  5)  algorithmic  tools,  6)  visual  data  mining  tools,  7)  web  tools 
and  packages,  and  8)  scientific  visualization  tools  for  modeling  complicated  physical 
phenomena.  Short  term  and  long  term  roadmaps  for  consumer  and  industrial  application  of 
visual  analytics  were  forecasted  in  the  following  contexts:  drivers,  markets,  products  and 
solution,  and  technologies.  Mobile,  collaborative  devices  deploying  haptic  interfaces  exemplify 
one  of  the  long  term  prospects  that  the  authors  envisioned  on  the  horizon. 

Monczka,  Handfield,  Giunipero,  and  Patterson  (201 1)  presented  a  study  that  was  conducted  in 
2008  that  considered  visibility  to  be  the  number  one  capability  that  allows  an  organization  to 
assess  its  supply  chain  risk  management  (SCRM).  The  secondary  and  tertiary  capabilities 
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included  early  warning  systems  and  supply  chain  analytics,  so  that  risk  events  can  be  better 
understood. 

Cristensen  (2005)  proposed  that  adding  a  third  dimension  to  the  traditional  performance  versus 
time  visual  analytic  helps  see  disruptive  innovation  through  a  new  lens.  Adding  “non-consuming 
occasions”  to  the  axis  system  presents  an  additional  view  of  the  industrial  base  that  allows  the 
product  model  to  start  assessing  untapped  IB  opportunities.  Cristensen  also  presented  a  pyramid¬ 
shaped  process  where  the  bottom  of  the  pyramid  involves  observing,  describing,  and  measuring 
phenomena.  Flowing  upward,  the  middle  of  the  pyramid  involves  categorizing  the  observed 
phenomena  by  attributes.  Finally,  the  top  of  the  pyramid  is  where  preliminary  statements  of 
correlation  are  proposed  and  investigated  further.  Ascending  the  pyramid  is  analogous  to 
zooming  out,  or  entering  into  the  analysis  phase  established  by  Kimmel  (2005).  Operating 
within  an  interface  that  offers  fluidity  between  the  measured  phenomena  (observed  during 
experimentation)  and  the  hypotheses  (proposed  during  requirements  generation)  points  to  a 
Model-Based  Systems  Engineering  (MBSE)  atmosphere. 

Feydesdorff  &  Meyer  (2006)  propose  the  use  of  multiple  axes  in  their  triple  helix  model,  that 
considers  additional  perspectives,  which  enables  the  specification  of  relevant  categories  for 
observation  in  terms  of  expectations.  Feydesdorff  &  Meyer  explain  how  a  diffusion  dynamics 
parameter,  pulled  by  an  economic  system’s  thirst  for  profit,  is  responsible  for  distributing 
systems  into  other  domains,  sometimes  to  their  own  demise.  An  example  is  given  on  a  co¬ 
evolution  that  initially  exists  between  the  knowledge-production  function  and  local  Italian 
markets.  Once  an  innovation  travels  a  certain  distance  along  its  trajectory,  is  dissolves  into  a 
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new  stage  of  challenges  and  opportunities.  In  this  paper,  an  outcome  to  a  collaborative  situation 
is  a  3D  trajectory  showing  signs  of  variation  and  sensitivity  with  respect  to  an  orthogonal  frame 
representing  industry,  academia,  and  government  relations.  This  tri-lateral  relationship  between 
industry,  academia,  and  government  is  a  useful  insight  to  explore  further  in  an  MBSE 
atmosphere  targeting  the  ground  vehicle  robotics  industrial  base. 

Blackburn,  Mazzuchi,  &  Sarkani  (2012)  held  that  the  Quality  by  Design  (QbD)  approach,  when 
coupled  with  TRIZ  (Russian  inventive  problem  solving)  principles,  addressed  more  physical  and 
technical  contradictions  with  inventive  solution,  thus  thwarting  the  psychological  inertia  (PI) 
associated  with  engineers  stepping  outside  their  background  to  observe  useful  patterns.  The 
authors  deemed  that  aligning  the  39  abstracted  engineering  parameters  with  the  40  already 
successful  inventive  principles  eliminated  system  contradictions  better  than  the  idea  generation 
heuristics  derived  by  trial  and  error  alone.  Observing  and  applying  patterns  reuses  the  expertise 
of  experienced  designers  and  is  considered  to  be  a  low  investment  with  high  potential  returns  - 
therefore,  TRIZ  is  considered  to  be  a  heuristic  approach  to  innovation  with  applicability  to 
manufacturing  systems  and  supply  chains.  Traditional  approaches  such  as  Quality  by  Inspection 
(Qbl)  and  Quality  by  Testing  (QbT),  popular  in  the  pharmaceutical  industry,  were  contrasted  in 
the  paper  under  the  format  of  trade  studies.  TRIZ,  which  taps  into  the  diversity  gathered  from 
working  in  different  industries,  is  an  effective  approach  to  complementing  defense  competence 
with  automotive  industry  experience,  for  example.  Process  Analytical  Technology  (PAT)  is 
another  emerging  system  for  designing,  analyzing,  and  controlling  manufacturing  through  timely 
measurements  and  is  used  as  one  of  the  baselines  in  the  trade  studies.  Some  of  the  various 
methods  for  alternative  rankings  and  across-pattern  comparisons  were  explained  which  include 
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affinity  ranking,  ratio  method,  tradeoff  methods,  swing  weights,  rank-order  centroid  techniques, 
the  analytic  hierarchy  process  (AHP),  balance  beam,  and  lottery  questions.  Two  tradeoff  metrics 
were  used  in  the  paper  involving  quantities  like  the  percent  of  contradictions  that  have  at  least 
one  high-ranked  conceptual  solution  and  average  ranking  of  all  conceptual  solutions  within  each 
alternative.  Alternatives  that  address  more  conflicts  with  effective  inventive  solutions  suggest 
that  better  system  performance  will  be  achieved.  Finally,  a  sensitivity  analysis  follows  that 
affinitizes  inventive  solutions  in  logical  categories  and  counts  the  frequency  of  occurrences, 
while  differentiating  the  degree  of  contradiction  resolution  within  each  category.  Engineering 
Design,  PAT,  and  Product  Development  were  the  top  three  inventive  solutions  in  the  affinity 
ranking  and  were  depicted  in  a  visual  analytic  that  resembles  a  Pareto  chart  with  stacked  vertical 
bars  representing  the  count  of  high,  medium,  and  low  ranks. 

Fey  (2012)  instructed  that  the  act  of  zooming  in  and  out  amongst  different  levels  of  analysis 
helps  remind  TRIZ  practitioners  that  their  problems,  and  thus  their  solutions,  are  probably  not 
unique  to  their  industry.  Problem  spaces  can  manifest  themselves  differently  under  varying 
zoom  levels,  such  as  a  curve  resembling  a  segment,  when  under  high  magnification.  Visual 
models  often  lead  to  mathematical  models  which  lead  back  to  geometry.  In  fact,  TRIZ 
breakthroughs  are  commonly  depicted  as  geometric  and  mathematic  representations  dwelling 
outside  of  some  familiar  domain  represented  as  a  geodesic,  in  and  of  itself,  and  apply  to  topics 
like  supply  chain  streamlining  (pp.  8-10).  In  fact,  the  evolution  of  successful  systems  proceeds 
along  universal  vectors,  or  laws  of  evolution.  Fey  presented  visual  analytics  like  System 
Conflict  Diagrams,  technology  improvement  S-curves,  and  Customer-Satisfaction  Models. 

These  depictions  are  not  unlike  the  paradigm  shift  S-curve  of  Christensen  (2005)  and  the  Kano 
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Model  reviewed  by  Chowdhury  (2002,  p.  90).  TRIZ  leverages  cognitive  splits,  similar  to  Lean 
Six  Sigma  (ESS)  and  Kepner  Tregoe  (KT)  practices,  including  primary  and  auxiliary  functions, 
as  well  as  requirement  conflicts  and  distinctions.  Eey  offered  that  some  visual  representations  are 
more  thought  provoking  than  others,  which  suggests  opportunities  for  subsequent  research. 

Tian,  Zhong,  Xiao,  Du,  and  Yang  studied  the  integration  of  axiomatic  design  (AD)  and  TRIZ  for 
the  conceptual  design  of  heating  and  drying  equipment  in  a  bitumen  reproduction  device  (2010). 
The  main  premise  of  TRIZ  was  presented,  along  with  AD,  described  as  a  systematic  problem 
solving  tool  based  on  the  application  of  two  axioms:  1)  the  independence  axiom  and  2)  the 
information  axiom.  The  independence  axiom  states  that  the  functional  requirements  (ERs)  of  the 
problem  should  be  independent  of  one  another,  whereas  the  information  axiom  states  that  the 
better  solution  has  minimal  information  content.  The  four  domains  of  AD  are:  1)  the  customer 
domain,  2)  the  function  domain,  3)  the  physical  domain,  and  4)  the  process  domain.  Solutions 
are  generated  by  mapping  requirements  of  one  domain  against  a  set  of  characteristic  parameters 
in  an  adjacent  domain.  A  series  of  iterations  between  ERs  and  design  parameters  (DPs)  is 
advised.  The  three  categories  of  design  manifest  themselves  into  matrix  patterns  that  are  visually 
recognizable  between  uncoupled,  decoupled,  and  coupled  decrees.  The  authors  presented  the 
integrated  model  in  six  steps,  with  an  accompanying  flowchart,  including:  1)  requirements 
transformation,  using  Quality  Eunction  Deployment  (QED),  2)  construction  of  ERs  and  DPs 
(using  AD),  3)  design  matrix  assessment  (in  terms  of  coupling),  4)  coupling  resolution  (using 
TRIZ),  5)  design  matrix  reassessment,  and  6)  detailed  design.  Einally,  heating  and  drying 
equipment  design  alternatives  were  represented  as  PR  and  DP  matrices  exhibiting  decoupled  and 
uncoupled  behavior.  Using  TRIZ  to  transform  the  technological  contradictions,  design 
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alternatives  were  refined  and  compared  in  terms  of  their  DPs,  proving  that  the  integrated  model 
enabled  the  decision  making  process,  as  predicted. 

Mehta  &  Cooper  (201 1)  held  that  design  is  essentially  a  process  of  generating  knowledge  about 
how  to  build  new  systems  and  results  in  structured  libraries  of  design  projects  and  risk 
assessments.  Using  an  integrated  circuit  (IC)  example  to  represent  a  textbook  platform-based 
design  (PBD),  the  authors  explained  how  each  IC  layer  is  developed  with  reuse  as  one  of  the 
objectives.  With  the  advent  of  cyber-physical  systems  (CPSs),  embedded  systems  PBD 
approaches  consider  physical  elements  as  devices  that  merely  provide  feedback  to  software. 
Therefore,  CPSs  have  much  more  flexibility  around  definition  of  platform  layers  which  leads  to 
variation  in  hierarchical  representation  of  systems  across  design  teams  and,  thus,  reduces 
reusability  of  platforms.  Each  layer  means  something  different  in  each  instantiation  of  the 
system.  In  fact,  platforms  are  thought  of  as  libraries  of  design  projects  at  different  levels  of  a 
systems  configuration  hierarchy.  The  authors  offered  that  the  key  to  the  success  of  PBD  is  the 
taxonomies  of  the  platforms.  A  ground  vehicle  (GV)  example  was  constructed  from  previous 
instantiations,  showing  taxonomies  like:  hull/frame  body/cab,  ground  interface,  powerpack,  drive 
train,  system  survivability,  and  lethality.  Although  software  developers  try  to  define  and  control 
all  interactions  between  modules  and  objects,  many  interactions  remain  unknown  at  the  time  of 
design  and  are  only  discovered  during  testing  or  deployment.  Therefore,  interactions  must  be 
captured  upstream,  during  risk  assessments,  which  are  meant  to  identify  the  risks  of  system 
failure.  All  in  all,  the  knowledge  transfer  across  design  teams  that  is  possible  with  a  hierarchical 
PBD  (and  accompanying  risk  assessment)  has  a  greater  benefit  to  more  complex  systems  and 
those  with  longer  product  development  cycles. 


36 


UNCLASSIFIED 


Wang  &  Dunston  (2006)  agree  with  Ellis,  Gibbs,  &  Rein  (1991)  in  that  groupware  entails 
computer-based  systems  that  support  groups  of  people  engaged  in  a  common  task  and  interacting 
in  a  shared  environment.  Wang  and  Dunston  distinguish  between  an  augmented  reality  (AR) 
system  of  collaboration  and  a  teleoperation  class  of  systems.  Collaborative  AR  occurs  when  the 
real  environment  is  augmented  by  another  user  without  solely  relying  on  previously  stored 
information.  Allowing  users  to  be  aware  of  the  activities  of  other  users,  aside  from  human- 
human  communication  services,  was  one  of  the  themes  of  the  paper.  The  authors  indicated  that 
AR  has  more  applicability  in  the  construction  domain,  due  to  large  distances  between  mobile 
work  crews,  but  this  characteristic  is  common  to  any  other  support  team  developing  and 
maintaining  systems  in  the  Army.  Categories  of  AR  systems  are  explored  which  include  number 
of  users,  degree  of  mobility,  and  space  (proximity  of  users  to  one  another).  In  addition,  some 
noted  AR  examples  for  each  of  the  categorical  combinations  are  given.  Wang  &  Dunston 
explain  some  of  the  issues  associated  with  multi-user,  face-to-face  systems,  including  social 
distractions  (non-task-related  topics)  and  model  disorientation  amongst  distributed  users, 
following  the  model  navigation  of  another  distributed  user.  On  the  other  hand,  virtual  space 
systems  that  witness  a  small  gain  in  efficiency  (due  to  a  decrease  in  social  distraction)  experience 
difficulties  in  voice  transmission  and  added  effort  to  feedback  information.  Wang  &  Dunston 
(2009)  also  found  that  frustration  levels  and  conceptual  performance  were  significantly  improved 
(up  to  41.4%),  during  experiments  deploying  a  range  of  Mixed  Realities  (MR),  competing 
against  a  range  of  Augmented  Reality  (AR)  and  Augmented  Virtuality  (AV). 
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Ries,  Lance,  and  Sajda  described  brain-computer  interaction  technologies  (BCITs)  that  enable 
large  datasets  to  be  accurately  interrogated  by  analysts  in  a  short  amount  of  time  (201 1).  Ries, 
Lance  and  Sajda  recognized  the  speed  and  precision  of  the  human  visual  system  to  pick  up 
minute  distinctions  in  various  stimuli  and  establish  SA.  Using  measured  neural  signal  data,  such 
as  electroencephalography  (EEG),  experiments  were  conducted  to  identify  when  an  observer 
detects  a  sought  after  pattern  or  target.  Integrating  a  Cortically-Coupled  Computer  Vision  (CSV) 
system  with  a  rapid  serial  visual  presentation  paradigm  (RSVP),  three  different  methods  were 
trialed:  1)  computer  first,  2)  human  first,  and  3)  a  tightly-coupled  method,  where  the  P300  RSVP 
task,  as  well  as  the  computer  vision  ran  in  an  iterative  fashion  to  aid  in  target  detection.  The 
tightly-coupled  method  showed  promising  results  in  that  over  four  times  more  targets  were 
detected  within  the  first  20  minutes,  over  the  other  baseline  methods. 


Ortland,  R.  J.,  Bissonnette,  L.  A.,  and  Miller,  D.  R.  (2010)  applied  data  mining  and  analysis  to 
proactively  assess  the  wear  of  military  ground  vehicle  components.  The  study  involved  the 
trending  and  graphic  display  of  equipment  demand  information  over  extended  periods  of  time. 
Equipment  deemed  most  critical  to  maintenance  was  given  priority  in  the  analysis.  Data  was 
gathered  from  information  sources  like  the  Integrated  Logistics  Analysis  Program  (ILAP),  the 
Operating  and  Support  Management  Information  System  (OSMIS),  and  the  Army  Materiel 
Systems  Analysis  Agency  (AMSAA).  With  the  ability  to  assess  entire  platforms  for  part  data 
trends,  the  authors  uncovered  strategic  trends  that  were  not  visible  when  looked  at  in  piecemeal 
High-volume,  low-price  parts  like  seals  and  bearings  were  found  to  represent  significant  total 
cost  to  platforms.  This  fact,  coupled  with  the  existence  of  instances  of  part  commonality 
between  platforms  gave  rise  to  the  same  parts  showing  up  on  multiple  lists.  The  data  review 
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process  made  extensive  use  of  charts,  graphs,  and  trend  analyses.  Specifically,  the  graphic 
representation  of  data  showed  particular  value  when  distinguishing  between  South  West  Asia 
(SWA)  and  non-SWA  patterns.  Feeding  the  results  of  the  analysis  into  Failure  Mode  Effects 
Analysis  (FMEA)  initiatives  concluded  the  study. 


Estefan  defined  methodology  as  the  overall  application  of:  1)  the  “what”  of  processes,  2)  the 
“how”  of  methods,  and  3)  the  corresponding  tools  and  meta  models  that  aid  in  process  and 
method  execution  and  development.  Estefan  surveyed  different  levels  of  MBSE  analysis 
abstraction,  as  well  as  the  connotations  of  model-driven  system  design  (MDSD),  including  state 
analysis  (SA).  Through  use  of  state  variables,  transient  states  are  defined  as  momentary 
conditions  of  an  evolving  system  and  contain  goals  and  constraints.  State  estimation  is  kept 
separate  from  state  control,  in  order  to  isolate  an  objective  assessment  of  a  particular  system. 
Estefan  also  depicts  a  visual  analytic  called  an  onion  model  that  uses  layers  of  SE  activities  to 
aid  in  cognition  and  solution  exploration  (2007,  pp.  28-37).  Distinctions  between  SE  process 
standards  DoD-MIE-STD  499,  DoD-MIE-STD  499B,  IEEE  1220,  ISO/IEC  15288:2002, 
ISO/IEC  19760,  NASA  NPR  7123.  lA,  and  ANSI/EIA  632  were  also  depicted. 


According  to  Dorf  &  Bishop  (201 1),  the  concept  of  a  system  state,  and  corresponding  state 
variables,  is  useful  in  analyzing  social  and  economic  systems  (p.  187).  The  state  variables 
describe  the  present  configuration  of  a  system  and  can  be  used  to  determine  the  future  response, 
given  the  excitation  inputs  and  the  equations  describing  the  dynamics  (p.  185).  Visual  analytics 
such  as  Mason’s  signal-flow  graphs  and  block  diagram  models  have  proven  to  aid  in 
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understanding  and  foster  innovation.  Therefore,  state  variables  and  state  analysis  are  systems 
modeling  points  of  view  that  require  further  attention  (Estefan,  2007,  p.  34). 


Samson  &  Peterson  (2010)  presented  an  application  of  a  Design  Structure  Matrix  (DSM)  that 
enables  the  modeling,  visualization,  and  analyses  of  any  system.  DSM  is  a  matrix-based  system 
modeling  methodology  that  may  be  applied  to  the  three  critical  domains  of  the  design  and 
development  of  systems:  1)  product,  2)  process,  and  3)  organization.  Each  domain  has  different 
ways  to  approach  the  populated  matrices  that  follow.  DSM  can  be  related  to  other  square-based 
matrix  methods  or  even  non-matrix-based  methods,  like  systems  of  equations.  After 
decomposing  products,  processes,  or  organizations,  the  relationship  or  pattern  of  interactions 
between  decomposed  elements  ends  up  defining  the  architecture.  There  are  two  types  of  DSMs: 
1)  temporal  (time-based  relationships  between  elements)  and  2)  static  (relationships  that  are  not 
time-based).  The  general  DSM  modeling  approach  consists  of  the  following  steps:  1)  define  the 
system  boundary,  2)  describe  important  interfaces,  3)  decompose  the  system  into  simpler 
elements,  4)  define  the  characteristics  of  the  elements,  5)  characterize  the  element  interactions, 
and  6)  analyze  the  system  architecture.  In  the  process  domain,  for  example,  the  result  is  a  visual 
analytic  that  offers  insight  into  iterative  information  flows  through  tasks,  depicted  as  x’s  in  a 
square  matrix  with  a  boundary  along  the  diagonal,  where  the  tasks  associated  with  column 
headings  transfer  information  to  those  tasks  associated  with  row  headings.  Conversely,  the  tasks 
associated  with  row  headings  require  information  from  those  tasks  associated  with  column 
headings.  Depending  on  how  the  x’s  are  clustered,  gives  a  visual  indication  of  how  they  interact 
and  how  they  might  be  resequenced.  Overall,  a  process  DSM  can  prove  to  be  a  framework  for 
knowledge  management.  Within  the  product  domain  the  interactions  get  classified  and 
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quantified  prior  to  clustering  like-pattems  together.  Analysis  of  the  system  architecture  in  this 
manner  identifies  functional  modules  and  distributed  subsystems  and  can  generate  alternative 
views  on  system  architecture.  Organizational  decomposition,  on  the  other  hand,  requires  an 
understanding  of  the  elements  and  their  relationships.  The  authors  stated  that  the  greatest 
leverage  in  organizational  architecting  lies  between  the  relationships.  In  fact,  an  organization’s 
inability  to  integrate  team  structures  can  lead  to  information  overload.  The  resulting  DSM  for 
organizations  offers  single-picture  visibility  on  the  communication  frequency  amongst  teams. 

Pilemalm,  Hallberg,  Sparf,  and  Niclason  (2012)  reported  on  their  experiences  of  model-based 
development,  using  case  studies  from  the  Swedish  Armed  Forces.  The  top  identified  challenges 
in  the  model-based  development  and  implementation  processes  were  found  to  be  common 
organizational  and  system  development  related  problems  like:  change  management,  team 
participation,  and  execution  of  requirements  engineering.  The  authors  state  that  there  is  a  need 
to  study  aspects  of  model-based  development  and  implementation  from  the  perspectives  of 
organizations,  practitioners,  and  system  stakeholders.  The  basis  for  model-based  development 
includes:  1)  development  processes,  2)  meta  models,  3)  relations  and  transformations.  Although 
models  can  be  paper-based,  computer-based,  1 -dimensional  or  multi-dimensional,  manually  or 
automatically  generated,  this  study  refers  to  computer  models,  generated  manually,  using  COTS 
tools  feeding  an  architectural  framework.  The  Ministry  of  Defense  Architectural  Framework 
(MODAF),  North  Atlantic  Treaty  Organization  Architectural  Framework  (NAF),  Department  of 
Defense  Architectural  Framework  (DODAF),  and  The  Open  Group  Architecture  Framework 
(TOGAF)  were  discussed  as  well  as  a  unified  profile,  called  (UPDM),  attempts  to  create  a 
standard  Unified  Modeling  Fanguage  (UMF)  profile  between  architectures.  UPDM  shares 
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concepts  with  SysML  and  can  be  considered  as  a  meta  model  that  allows  non-technical  experts 
to  participate  in  strategic  decisions,  where  a  full,  system  stakeholder  perspective  is  often  missing. 
The  authors  state  that  the  application  of  models  to  the  development  of  capabilities  constitutes 
pioneering  work.  The  four  projects  exemplified  in  the  study  included:  1)  business  management 
software,  2)  future  command  and  control  systems,  3)  capabilities  modeling,  and  4)  requirements 
for  equipment  in  an  international  peace  operation.  A  MODAF  visual  analytic  resembling  a 
Swim  Lane  Diagram  was  presented,  illustrating  how  human  and  technical  functions  support 
missions.  Midway,  the  authors  recommended  protocols  for  conducting  case  studies  while 
explaining  their  rationale  for  conducting  interviews.  The  interviews  resulted  in  three  themes, 
including:  1)  process  development,  2)  organizational  implementation,  and  3)  organizational 
implications.  These  themes  were  further  subdivided  into  several  layers,  each  with  their  own 
lessons  learned.  Some  of  the  lessons  learned  communicated  in  the  study  were:  1)  model-based 
atmospheres  help  identify  the  task  redundancies  and  pedagogical  perspectives  of  different 
organizations,  2)  model-based  protocols  promote  a  universal  language  and  architecture  with 
which  to  work,  3)  model-based  protocols  help  enforce  critical  information  sharing  upstream 
when  the  success  of  projects  is  most  volatile,  4)  having  a  model-based  framework  helps  identify 
early  on  the  stakeholder  representatives  who  were  lacking  sufficient  domain  knowledge  to 
perform  tasks,  and  5)  the  framework  enforces  systems  requirements  to  be  drawn  from  the 
emerging  models.  For  model-based  development  to  be  successfully  implemented,  more 
resources  need  to  be  allocated  toward  information  management,  marketing,  and  education,  as 
these  areas  required  more  than  was  initially  expected  (especially  in  the  initial  phases).  Several 
projects  also  reported  that  many  stakeholder  representatives  did  not  represent  the  real  users  and 
did  not  carry  out  their  tasks  as  organizational  integrators.  In  addition,  the  survey  respondents 
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described  that  the  organizational  implementation  process  encompassed  more  obstacles  than  the 
developmental  phases.  The  modeling  of  the  processes  was  reported  as  creating  an  organizational 
memory,  in  addition  to  providing  a  fundamental  overview  and  clarity  of  organizational  vision, 
missions,  and  individual  responsibilities,  which  were  noted  as  difficult  to  find.  In  fact,  the  lack 
of  connection  between  overall  goals,  strategies,  and  models,  along  with  a  lack  of  purpose,  have 
led  to  uncertainty  in  terms  of  what  should  be  modeled.  Premodeling,  or  preliminary  information 
gathering,  required  more  attention  and  should  not  be  deemed  as  unproblematic.  Surprisingly, 
most  of  the  obstacles  experienced  do  not  even  relate  to  the  model-based  processes,  but  rather 
manifest  themselves  as  general  systems  and  organizational  development  problems  -  therefore, 
the  lines  of  demarcation  between  the  two  disciplines  are  blurred.  The  study  confirmed  that  these 
obstacles  were  deemed  more  challenging  than  the  more  technical  modeling  work  and  the  models 
themselves.  Although  the  acceptance  level  for  model -based  approaches  was  observed  as  low, 
the  respondents  speculated  that  a  model-based  atmosphere  will  lead  to  a  more  functioning  and 
structured  organization,  where  an  elimination  of  double  work  will  lead  to  higher  profits. 
Unfortunately,  none  of  the  reported  projects  performed  a  risk  analysis  on  the  model-based  way 
of  working.  In  summary,  the  authors  state  that  a  solid  combination  of  scientific  research  and 
practical  experience  is  needed  to  carry  out  the  inherent  complexity  of  a  model-based 
development  approach. 


Mendonza  &  Fitch  (201 1)  proposed  mapping  all  SE  knowledge  to  a  database  of  object  classes 
and  subclasses  (within  appropriate  hierarchies),  while  leveraging  the  evolution  of  attributes  and 
relationships,  as  opposed  to  relying  on  view-based  artifacts  (e.g.  DODAF)  that  typically  fall 
victim  to  clerical  degradation  and  unnecessary  variance.  Distinguishing  Object-Based  Systems 
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Engineering  (OBSE)  from  that  of  MBSE,  Mendonza  &  Eitch  agreed  that  only  OBSE  truly 
captures  the  essential  elements  (e.g.  objects,  attributes,  relationships)  of  SE,  fully  noting  that 
information  architecture  may  vary  for  different  domains.  An  OBSE  focus  brings  to  light  benefits 
which  include:  1)  artifact  reproduction  through  concatenation  of  object  attributes  and 
relationships,  2)  a  shift  towards  object  quality  reviews  (as  opposed  to  document  reviews),  and  3) 
the  capability  to  proactively  analyze  diagrams  and  tables.  Roadblocks  to  the  realization  of 
OBSE  include:  1)  process  intertia,  2)  tool  limitations,  3)  stovepiped  cultures,  and  4)  the 
interaction  between  tight  budgets  and  fear  of  scope  creep.  Differences  between  the  connotations 
of  terms  like  “methodologies”  versus  “principles”,  as  well  as  “architectures”  versus 
“foundations”  were  also  discussed.  Similar  to  coupling  theory  in  AD,  the  traceability  between 
SE  questions  and  answers  was  presented  in  the  form  of  an  N-Squared  Diagram  that  reveals 
interactions  between  diagonal  nodes  representing:  1)  Statement  of  Work  (SOW),  2)  Work 
Breakdown  Structure  (WBS),  3)  Decisions,  4)  Architecture,  5)  Requirements,  and  6)  Tests. 

Using  the  SE  Vee-model  as  a  methods  engine,  a  decision-to-requirement  traceability  was 
researched.  Offering  that  each  object  class  evolves  through  a  series  of  states  and  that  system 
states  activate  and  deactivate  functions,  the  authors  offered  that  object-level  versioning  captures 
states  as  attribute  and  relationship  differentials.  Capturing  the  logic  behind  the  knowledge 
derivation  is  of  high  importance  and  uncertainty  is  to  be  reduced  through  investments  in 
stochastic  M&S  that  exposes  instances  of  knowledge  in  the  form  of  single  instances  of  objects 
viewed  through  multiple  lenses.  Studying  the  attributes  of  the  links  between  objects,  sensitivity 
analysis  can  be  performed,  using  simulation  models.  In  summary,  the  authors  state  that  a  class- 
based  model  encourages  efficient,  focused  brainstorming,  just  as  a  shared  information  model 
fosters  collaboration. 
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Mendonza  &  Fitch  (2012)  stated  that  effective  decision  management  (DM)  is  much  more  than  a 
mere  Analysis  of  Alternatives  (AoA)  and  is  comprised  of  three  elements:  1)  decision  patterns 
through  which  subject  matter  experts  influence  designs  with  their  unique  knowledge  ,  2)  a  DM 
methods  engine,  and  3)  a  decision-centric  information  model.  DM  can  be  the  key  enabler  for 
accelerating  the  benefits  of  the  SE  discipline  to  new  industries  and  domains.  A  decision  pattern 
was  defined  as  a  hierarchical  model  of  the  problem  domain  in  which  each  decision  represents  a 
fundamental  question/issue  that  demands  an  answer/solution.  The  decision  pattern  forms  a 
Decision  Breakdown  Structure  (DBS)  which  contains  nodes  like  “state  model”  and  “support”, 
among  others.  In  the  DBS,  three  types  of  decision  are  included:  1)  single  answer  decisions,  2) 
multiple  answer  decisions,  and  3)  multi-part  answer  decisions.  Every  system  is  said  to  have  a 
functional  model  and  needs  a  bounded  mission  scope  from  which  its  operational  requirements 
are  derived.  A  rapid  reverse  engineering  exercise,  known  as  a  Decision  Blitz,  was  discussed  that 
maps  existing  systems  to  decision  patterns.  The  authors  emphasized  that  DM  is  scalable,  due  to 
it  being  domain-independent.  Specifically,  for  the  decision-centric  information  model,  the  object 
classes  and  their  relationships  have  ties  to  human  thinking  and  cause  &  effect  patterns,  not  based 
on  a  specific  type  of  system,  industry,  or  use  case.  Information  visualization  and  the  importance 
of  proactive  identification  and  prioritization  of  decisions  was  also  stressed.  Overall,  the 
challenges  of  deploying  a  traditional  SE  framework,  utilizing  MBSE,  were  covered.  Capturing 
the  system  model,  instead  of  the  thinking  model,  was  cautioned.  In  summary,  the  authors  felt 
that  a  tool-driven  SE  outreach  strategy  would  work  best  when  it  is  built  around  a  specific  tool 
that  already  has  gained  traction  among  engineers.  Also,  cross -pollinating  SE  tools  to  other 
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groups  could  be  accelerated  if  SE  champions  from  other  industries  have  already  infiltrated  the 
target  domain. 


Mendonza  (2012)  presented  the  TARDEC  Advanced  Systems  Engineering  Capability  (ASEC) 
which  is  an  integrated  SE  knowledge  creation  and  capture  framework  built  on:  a  decision-centric 
method,  high  quality  data  visualizations,  data  traceability,  real-time  collaboration,  and 
knowledge  pattern  leverage.  The  ASEC  framework  consists  of  three  parts:  1)  Problem  Space 
(Inputs),  2)  Innovation/ Analysis  Space,  and  3)  Solutions  Space  (Outputs).  Mendonza 
emphasizes  the  utility  of  the  meta  model  containing  the  full  system  information.  The  five 
models  from  which  SE  knowledge  is  created  and  captured  include:  1)  SE  Vee  Model,  2)  M&S 
Models,  3)  Architecture  Model  (SysME),  4)  Eifecycle  Models  (e.g.  sustainability),  and  5) 
Roadmap  Model.  Some  of  the  benefits  of  ASEC  include:  improved  ability  to  visualize  choices, 
decision  patterns  are  highlighted  that  extend  subject  matter  expert  influence,  and  a  traceability  to 
upstream  decisions  from  which  requirements  have  been  derived.  Presenting  and  displaying 
object-based  SE  knowledge  pertaining  to  multi-dimensional  systems  trade  space  allows  for  fast 
comprehension  and  decision  making.  With  ASEC,  alternatives  reflecting  quantitative  and 
qualitative  data  are  visually  stacked,  between  the  threshold  and  objective  criteria  values,  before 
being  discriminated  based  on  scores.  After  some  collaboration,  it  is  suspected  that  Mendonza’s 
ASEC  will  be  the  target  framework  with  which  to  integrate  the  IB  modeling  application  of  this 
research  proposal.  After  all,  within  ASEC,  the  decision  model  for  a  system  provides  the 
integration  point  for  all  other  system  models  (Mendonza,  personal  communication,  January  25, 
2013).  Woody  &  Hoff  (2010)  offer  an  analogous  middleware  solution  to  managing 
independently  developed  applications  that  provide  SA  data  to  Warfighters.  What  is  deemed  as 


46 


UNCLASSIFIED 


an  Application  Framework,  an  overarching  infrastructure  orchestrates  coexisting  applications 
like:  1)  command  and  control,  2)  sensor  control,  3)  presentation,  and  4)  communication  that  can 
be  selectively  deployed  based  on  mission  parameters  and  objectives. 


Taylor  (1990,  pp.  123-125)  taught  that  the  more  that  models  are  used  for  multiple  applications  in 
an  object  database,  the  more  the  applications  lose  their  stovepiped  identities,  due  to  integration  of 
data.  This  results  in  the  refinement  of  shared  models  which  enables  the  simulation  of  various 
company  operations. 

COTS  supply  chain  management  software  tools  like:  ProModel,  Supply  Chain  Sherpa,  Supply 
Chain  Guru,  Supply  Solver,  SDI  Industry  Pro,  and  IBM  Supply  Chain  Analyzer  have  varying 
utility,  but  still  do  not  provide  the  holistic  view  and  strategic  sustainment  analysis  capability  that 
TARDEC  needs  to  proactively  assess  military  sustainment  support  strategies.  Moreover, 
acquiring  new  COTS  tools  instead  of  fully  utilizing  TARDEC ’s  existing  licenses  of  COTS 
software  is  not  recommended  in  this  research  proposal.  COTS  capability  already  exists  to 
visualize  multiple  system  requirements,  behavior,  structure,  and  parametrics,  while  managing 
mission  resource  allocation  amongst  an  enterprise  of  organizations  (Friedenthal,  2012,  p.  11). 
Considering  that  energy  and  resource  distribution  follow  definite  paths  which  can  be  analyzed  by 
means  of  geometric  construction,  3D  models  can  inspire  more  what-if  analysis  capability 
through  the  interactive  deployment  of  visual  analytics  (Taylor,  1990,  p.  80;  Schneider,  1994,  p. 
78).  Many  times,  innovative  adaptations  of  COTS  solutions  meet,  or  exceed,  system 
expectations.  For  example,  although  typically  only  thought  of  in  the  product  design  genre,  it  is 
suspected  that  Pro  Engineer  (Pro/E)  has  the  capability  and  availability  to  bring  to  light  many  of 
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the  multiple  dimensions  and  layers  of  the  sustainment  IB.  Used  in  conjunction  with  other  COTS 
tools  encouraged  by  the  DEMs  curriculum  (e.g.  Arena,  Minitab,  Octave,  EabVIEW,  Maple), 
M&S  scenarios  can  be  economically  tested  in  a  benign,  proactive  environment  orchestrated  by 
SysME,  which  is  recommended  by  INCOSE.  MajicDraw,  for  example,  is  one  of  the  INCOSE- 
recommended  COTS  tools  that  can  be  used  to  quickly  exercise  SysME  to  frame  any  M&S  efforts 
being  conducted.  Specifically,  by  populating  some  of  the  primary  SysME  diagrams  with 
structured  links  to  models  from  other  domains,  the  untapped  community  of  IB  stakeholders  will 
be  forced  to  calibrate  their  everyday  language  and  activities,  filling  TACOM  IB  analysis  voids, 
while  simultaneously  thwarting  unconscious  redundancy. 


Strategic  analysis  involves  zooming  out  from  the  current  view.  A  model  that  has  the  capability 
to  toggle  back  and  forth  between  high  level  perspectives  and  low  level  perspectives  is  an  asset  to 
a  strategic  analyst  (Kleijnen,  2005;  Kimmel,  2005;  Patria  2010;  Bean  2011).  Eor  example,  the 
macro  view  of  a  supply  chain  is  its  parent  IB.  Kimmel  (2005)  explained  how  the  macro  phase, 
itself,  is  to  be  thought  of  as  the  analysis  phase.  Erom  this  analogy,  it  can  be  concluded  that  IB 
analysis  delves  more  into  the  strategic  planning  discipline  than  does  mere  supply  chain 
management.  Kimmel  also  establishes  that  the  most  detailed  micro  view  is  the  code  of  the 
modeling  language  itself.  It  is  important  to  acknowledge  the  precautions  of  relying  solely  on  the 
modeling  language  code,  however  (Bell,  2004;  Booch,  2004).  Sole  reliance  on  the  modeling 
language  code  ignores  the  strategic  side  of  what  should  be  a  value-added  modeling  approach. 
Consciously  exploiting  the  strategic  lens  of  an  IB  model  helps  to  understand  the  problem  space. 
Capturing  classes  and  relationships,  as  the  problem  space  is  being  studied,  is  advised  in  the 
literature.  As  the  details  of  the  model  are  characterized,  moving  from  a  macro  understanding  to  a 


48 


UNCLASSIFIED 


more  detailed  micro  understanding  allows  the  community  to  elaborate  on  a  solution  design.  At 
this  point,  reviewing  class  diagrams  and  adding  operations  and  attributes  is  advised.  Operations, 
behaviors,  and  methods  all  refer  to  the  same  thing,  although  UML  generalists  use  the  word 
“operation”,  but  when  coding,  the  word  “method”  is  most  popular  (Kimmel,  2005). 


In  conclusion,  the  specification,  analysis,  design,  and  verification  of  the  entire  sustainment  IB,  as 
a  system,  is  a  multi-dimensional  entity.  Acknowledging  the  influence  of  IT,  missions  involving 
IB  data  access  and  strategic  decision  making  can  be  considered  as  use  cases  in  a  systems  design 
interface  where  various  agencies  can  “explore  the  behavior  of  many  objects  across  a  use  case” 
(Kimmel,  2005).  This  kind  of  lateral  thinking  facilitates  SA  and  enables  pattern  recognition 
(Dew,  2006).  Once  patterns  are  exposed,  innovation  can  follow.  TRIZ  innovation  is  often 
thought  to  be  a  novel  adaptation  of  ancient  physics  and  existing  geometry,  in  order  to  resolve  the 
secondary  problems,  or  contradictions,  unveiled  during  systems  analysis  (Clarke,  2005; 
Blackburn,  Mazzuchi,  Sarkani,  2012,  p.  357).  In  other  words,  trend  recognition  is  the  oftentimes 
considered  to  be  the  seed  of  the  fruit  of  innovation.  Analysis,  itself,  often  follows  the  S-curve  of 
technology  improvement  as  analysts  begin  with  alphanumeric  lists,  then  evolve  to  2D  visual 
analytics,  then  interact  with  a  distributed  workforce  using  3D  collaborative  models  (Carnegie, 
1944,  pp.  555-556;  Fey,  2012).  This  mind-set,  coupled  with  the  decision  to  use  the  momentum  of 
established  COTS  tools  upholds  Ashton  Carter’s  charge  to  “do  more  without  more”  (2010). 
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Research  Proposal 

To  develop  a  solution  to  the  problem  (stated  on  p.  9),  the  following  research  goals  are  proposed: 


Task  Name 

10 

INCOSEMBSESysMLctess 

11 

Submk  Revised  Abstract 

12 

Electives  Transfer  credit/waiver  in  wrting 

13 

OPSEC 

14 

Revised  Draft  Proposal  submitted  to  advisor/feedback 

15 

Revised  Committee  'Officially'  Selected 

16 

Proposal  to  Peers 

17 

Proposal  Exam 

18 

BEME8006  #3 

19 

Robotics  Platform  Data  Mining 

20 

Build  SysML  Diagrams 

21 

Build  Parametric  Visual  Analytics 

22 

Explore  State  Space  Relationsbips 

23 

B  EME8006  #4:  Develop  &  Submit  Dissertation  Draft 

24 

Assess  Sustainment  Risk  Relationsbips 

25 

Explore  Risk  Mligations 

26 

Evaluate  Aternate  Support  Strategies 

27 

BEME8006  #5 

28 

LinkM&S 

29 

Role  PlayWbat  If  Capability  of  Model 

30 

Defend  Dissertation 

31 

Submit  bound  copies  of  Final  Dissertation 
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Figure  10:  DBMS  research  Gantt  Chart 
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The  mathematical  basis  for  the  proposed  research  is  expected  to  center  around  the  general  form 
of  state-space  representation  which  includes: 

State  differential  equations  of  form: 

X=  Ax  +  BU  (Eq.  1) 

and  Output  equations  of  form: 

y  =  Cx  +  Du  (Eq.  2) 

where  Equation  1  can  be  expanded  to: 

%11  fall  al2  alnl Ixl 

x2  =  a21  a22  a2n  x2 

xn\  lanl  an2  ann\  Ixn 

(Eq.  3) 

Any  supporting  visual  analytics  that  aid  in  understanding  or  foster  innovation  will  be  explored. 
Both  mathematical  and  visual  analytic  models,  portrayed  in  a  synthetic  environment,  will  be 
linked  to  a  parent,  MBSE  framework  to  heighten  situational  awareness  and  demonstrate 
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improved  resource  continuity.  It  is  suspected  that  IB  and  sustainment  risks  pertaining  to  the 
Ground  Vehicle  Robotics  domain  will  be  analogous  to  the  excitation  of  transient  state  space 
input  signals.  Typical  systems  offer  several  choices  of  state  variable  sets  that  describe  the 
dynamics  of  systems,  but  state  variable  sets  which  can  be  scrutinized  by  robust  measurement 
systems  are  preferred  (Dorf  &  Bishop,  2011,  p.l87). 

Upon  completion  of  this  research,  a  cost  avoidance  is  anticipated,  due  to  a  more  focused 
allocation  of  human  resources  towards  IB  analysis.  This,  along  with  offering  a  broader 
understanding  of  sustainment  risk  amongst  Ground  Vehicle  Robotics,  promises  a  new  facet  of 
M&S  within  TARDEC.  Given  that  a  proportion  of  equipment  applications  historically  become 
reactive.  Diminishing  Manufacturing  Sources  and  Material  Shortages  (DMSMS)  issues,  proper 
risk  management  will  reduce  the  population  of  DMSMS  candidates. 

Business  Case 

Developing  awareness  of  DMSMS  indicators  is  the  first  stage  of  IB  risk  management. 

Therefore,  the  business  case  paradigm  for  this  research  proposal  could  be  viewed  as  the 
avoidance  of  cost  and  equipment  readiness  decline  associated  with  a  series  of  DMSMS  cases  that 
have  a  probability  of  occurring  and  are  treated  as  a  failure  of  sustainment  support  (see  Equation  4 
below) 


(Eq.  4) 
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Where  C  is  the  total  burden  to  the  platform,  n  is  the  number  of  DMSMS  cases  in  a  given  time 
frame,  P  is  the  probability  function,  D  is  the  cost  of  the  DMSMS  case,  and  (p  is  a  penalty 
function  that  burdens  a  platform  when  they  reside  below  equipment  readiness  thresholds  for  a 
given  time  frame. 

The  anticipated  investment  to  proliferate  an  MBSE  solution  that  encompasses  sufficient  IB 
analysis  is  expected  to  follow  a  modified  annuity  series  cash  flow  diagram  of  form: 

F 

n 

Figure  11:  Cash  Flow  Diagram  depicting  benefit  of  proposed  research 
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which  equates  to  a  breakeven  equilibrium  of: 
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(Eq.  5) 
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where  F  is  the  benefit,  or  the  avoided  cost  increment  (i.e.  markup)  per  mitigation  decision,  A  is 
the  cost  per  head,  or  the  fraction  of  time  each  analyst  spends  on  maintaining  the  proposed  IB 
model,  n  is  the  time  period  between  mitigation  decisions,  i  is  the  interest  rate  of  opportunity  cost, 
and  d  is  the  depth  of  how  many  analysts  presently  manage  equipment  for  the  command.  A  rough 
estimate  of  the  burden  on  human  capital.  A,  is  shown  in  Appendix  C,  with  d  set  at  200  analysts. 

In  which  case  the  overhead  cost  of  human  capital  is  fixed  at  A*d,  Newman  (1996,  p.  166)  simply 
recommends  to  maximize  the  equivalent  uniform  annual  benefits  (EUABs).  Note  that  the 
EUABs  manifest  themselves  as  an  avoided  markup,  F,  in  Eigure  10.  Both,  the  avoided  markup, 
F,  and  the  depth  of  analysts,  d,  are  presented  in  a  third  dimension  to  illustrate  the  cost-to-benefit 
tie  to  the  variable  pool  of  analysts  contributing  to  the  IB  model’s  upkeep.  In  other  words,  each 
analyst  will  be  responsible  for  maintaining  his/her  particular  aspect  of  the  IB  (for  which  they 
already  manage  equipment). 


With  respect  to  Equation  4,  the  cost,  D,  of  a  real  DMSMS  case  can  be  demonstrated  in  the 
following  example  where  a  reactive  demand  arises  for  fuel  lines  that  are  out  of  production.  The 
total  anticipated,  life  cycle  demand  calls  for  $7,552,000  of  fuel  lines  (3200  lines  *  8  lines  per  fuel 
pump  *  2  fuel  pump  variants  per  vehicle)  at  $147.50  per  line.  Approximately  one-third  of  the 
quoted  piece  price  can  be  attributed  to  a  markup  that  is  the  result  of  a  bounded  support  strategy. 
Market  constraints  like  this  that  are  identified  through  IB  M&S  (and  proactively  mitigated)  can 
equate  to  a  cost  avoidance,  F,  of  $2,5 17,333  (33%  of  $7,552,000).  Therefore,  substituting  3*E 
in  for  D,  in  Equation  4,  yields: 


C~S?=iP(3 


* 


d*  A 


(l+i)"- 


F] 


(Eq.  6) 


54 


UNCLASSIFIED 


Committee  Approval  of  Research  Proposal 


Signature 


Date 


Dr.  Alwerfalli,  Academic  Advisor 


Dr.  Overholt,  Industrial  Advisor 


Dr.  Ali,  Committee  Member 


Dr.  Riedel,  Committee  Member 


Dr.  Bindschadler,  Committee  Member 


55 


UNCLASSIFIED 


References 

Agarwal,  A.,  Shankar,  R.,  Tiwari,  M.  K.  (2007).  Modeling  Agility  of  Supply  Chain.  Industrial 
Marketing  Management,  443-457. 

Alaweih,  A.  (2006).  Effective  Utilization  of  Agile  Manufacturing  Facility  (AMF)  in  Solving 
Logistics  Problems  of  Tactical  Army  Vehicles  (Doctoral  Dissertation).  Lawrence 
Technological  University  College  of  Mechanical  Engineering. 

Appelqvist,  P.,  Lehtonen,  J.,  Kokkonen,  K.  (2004).  Modeling  in  Product  and  Supply  Chain 
Design:  Literature  Survey  and  Case  Study.  Journal  of  Manufacturing  Technology 
Management,  15  (7),  675-686. 

Army  Regulation.  (2011).  Army  Acquisition  Policy  (ARlO-l).  Washington,  DC:  Government 
Printing  Office. 

Army  Regulation.  (2004).  Army  Industrial  Base  Process  {ARlOO-90).  Washington,  DC: 
Government  Printing  Office. 

Army  Regulation.  (2012).  Integrated  Logistics  Support  Rapid  Action  Revision  (AR  700-127). 
Washington,  DC:  Government  Printing  Office. 

Aufenanger,  M.,  &  van  Liick,  P.  (2010).  Simulation-Based  Adaption  of  Scheduling 
Knowledge.  Winter  Simulation  Conference,  3376-3383. 

Azuma,  R.  T.  (1997).  A  Survey  of  Augmented  Reality.  Presence  (MIT  Press):  Teleoperators 
and  Virtual  Environments,  6  (4),  355-385. 

Barton,  R.  (2010).  Simulation  Experiment  Design.  Winter  Simulation  Conference,  15-%6. 

Baumbusch,  G.  G.,  &  Harman,  A.  J.  (1977).  Peacetime  Adequacy  of  the  Lower  Tiers  of  the 
Defense  Industrial  Base  (Document  No.  R-2184/1-AE).  Rand  Corporation. 


56 


UNCLASSIFIED 


Bean,  J.  (2011).  Logistics  and  Sustainment  for  Engineers  and  Scientists.  Warren,  Michigan: 
Tank  Automotive  Command  Life  Cycle  Management  Command. 

Bell,  A.E.  (2004).  Death  by  UML  Fever.  Association  for  Computing  Machinery  (QUEUE),  72- 
80.  Retrieved  from:  http://queue.acm.org/whatisqueue.cfm 

Billinghurst,  M.,  &  Hirokazu,  K.  (1999).  Collaborative  Mixed  Reality.  International 
Symposium  on  Mixed  Reality,  261-284. 

Blackburn,  T.  D.,  Mazzuchi,  T.  A.,  Sarkani,  S.  (2012).  Using  a  TRIZ  Eramework  for  Systems 
Engineering  Trade  Studies.  Systems  Engineering,  15  (3),  355-367. 

Bochenek,  G.,  Benson,  K.  C.,  Ramdass,  V.  S.  (2011).  Tank  Automotive  Research 

Development  and  Engineering  Center.  What ’s  on  the  Elorizon?  Future  Capabilities 
through  the  Logistics  Lens.  Slide  10. 

Booch,  G.  (2004).  The  Fever  is  Real.  Association  for  Computing  Machinery  (QUEUE),  80-81. 
Retrieved  from:  http://queue.acm.org/whatisqueue.cfm 

Budiu,  R.,  &  Nielsen,  J.  (2011).  Usability  of  iPad  Apps  and  Websites.  Nielsen  Norman  Group. 

Carnegie,  D.  (1944).  How  to  Stop  Worrying  and  Start  Living.  Hauppage,  New  York:  Dale 
Carnegie  &  Associates,  Inc. 

Carter,  A. S.  (2010).  Better  Buying  Power:  Guidance  for  Obtaining  Greater  Efficiency  and 
Productivity  in  Defense  Spending.  Washington  DC:  Office  of  the  Under  Secretary  of 
Defense  Government  Printing  Office. 

Chairman  of  the  Joint  Chiefs  of  Staff  Instruction.  (2012).  Joint  Capabilities  Integration 

Development  System  (CJCSI  3170.01H).  Washington,  DC:  Government  Printing  Office. 


57 


UNCLASSIFIED 


Chapman,  P.  (1994).  Logistics  Network  Modeling.  In  Robeson,  J.  and  Copacino,  W.  (Eds),  The 
Logistics  Handbook,  New  York:  The  Eree  Press. 

Chen,  H.T.  (1990).  Theory  Driven  Evaluations.  Newbury  Park,  CA:  SAGE  Publications, 

Inc.. 

Choi,  T.  Y.,  &  Hong,  Y.  (2002).  Unveiling  the  Structure  of  Supply  Networks:  Case  Studies  in 
Honda,  Acura,  and  DaimlerChrysler.  Journal  of  Operations  Management,  20  (5),  469- 
93. 

Chowdhury,  S.  (2002).  Design  for  Six  Sigma.  Chicago:  Dearborn  Trade  Publishing. 

Christensen,  C.  (2005).  Manager  as  Innovator.  Orem,  Utah:  Targeted  Learning  Corporation. 

Clarke  Sr.,  D.  W.  (2005).  Structured  Innovation:  Foundational  Elements.  West  Bloomfield, 

MI:  Applied  Innovation  Alliance,  EEC. 

Coyle,  P.  (2011).  The  2012  Budget:  Winning  the  Future  Through  Investments  in  Innovation, 
Education,  and  Infrastructure.  Executive  Office  of  the  President  of  the  United  States, 
17-18.  Retrieved  from 

http://www.whitehouse.gov/sites/default/files/microsites/ostp/PY12-slides.pdf 

Department  of  the  Army.  (2009).  Materiel  Enterprise  Transformation  Plan  (METP). 
Washington,  DC. 

Department  of  Defense  Directive  DoD  5000.01.  Defense  Acquisition  System.  (DoD,  November 
20,  2007) 

Dew,  J.  (2006,  January).  TRIZ:  A  Creative  Breeze  for  Quality  Professionals.  Quality  Progress, 
44-51.  American  Society  for  Quality. 


58 


UNCLASSIFIED 


Dorf,  R.  C.,  Bishop,  R.  H.  (2011).  Modern  Control  System.  Upper  Saddle  River,  NJ: 

Pearson  Education,  Inc.,  Publishing  as  Prentice  Hall. 

Dowlatshahi,  S.  (1996).  The  Role  of  Eogistics  in  Concurrent  Engineering.  International 
Journal  of  Production  and  Economics,  44,  189-99. 

Dowlatshahi,  S.  (1999).  A  Modeling  Approach  to  Eogistics  in  Concurrent  Engineering. 
European  Journal  of  Operational  Research,  115,  59-76. 

Dumond,  J.,  Eden,  R.A.,  Eolkenson,  J.  (1995).  Velocity  Management:  An  Approach  for 

Improving  the  Responsiveness  and  Efficiency  of  Army  Logistics  Processes  (Document 
No.  DB-126-1-A).  Rand  Corporation. 

Ebeling,  C.  E.  (1997).  An  Introduction  to  Reliability  and  Maintainability  Engineering.  New 
Delhi:  Tata  McGraw  Hill  Education  Private  Eimited. 

Economou,  J.  (2012).  Military  Autonomous  Vehicles  (MAV).  Eecture  Notes.  Cranfield 
University. 

Edwards,  T.  J.,  &  Eden,  R.  (1999).  Velocity  Management  and  the  Revolution  in 
Military  Logistics  (Document  No.  RP-752-1).  Rand  Corporation. 

Ellis,  C.  A.,  Gibbs,  S.  J.,  Rein,  G.  E.  (1991).  Groupware:  Some  Issues  and  Experiences. 
Communications  of  the  ACM  ,  34,  38-58. 

Estefan,  J.  A.  (2007).  Survey  of  Model-Based  Systems  Engineering  (MBSE)  Methodologies. 
International  Council  on  Systems  Engineering,  1-47.  Retrieved  from: 
http://www.incose.org/productspubs/pdf/techdata/mttc/mbse_methodology_survey_2008- 
061 0_revb  -j  ae2  .pdf 


59 


UNCLASSIFIED 


Etzkowitz,  H.  (2003).  Innovation  in  Innovation:  The  Triple  Helix  of  University-Industry- 
Go  vemment  Relations.  Social  Science  Information,  42  (3),  293-331 . 

Executive  Office  of  the  President  Office  of  Management  and  Budget.  (2012).  Circular  A-1 1; 
Preparation,  Submission  and  Execution  of  the  Budget.  Retrieved  from 

http://www.whitehouse.gov/sites/default/files/omb/assets/al  l_current_year/a_l  l_2012.pdf 

Eastabend,  D.  A.  (1997,  Autumn).  An  Appraisal  of  the  Brigade-Based  New  Army.  Parameters, 
73-81. 

Eey,  V.  (2012).  Innovation  on  Demand:  How  to  Generate  Powerful  Ideas  Faster.  Eecture 

Notes.  United  States  Army  Tank  Automotive  Research,  Development  and  Engineering 
Center. 

Eisher,  M.  (1997,  Mar- Apr).  What  is  the  Right  Supply  Chain  for  your  Product?  Harvard 
Business  Review,  105-15. 

Eixon,  S.  K.  (2004).  Product  Architecture  Assessment:  a  Tool  to  Eink  Product,  Process,  and 
Supply  Chain  Design  Decisions.  Journal  of  Operations  Management,  1-55. 

Eontaine,  Y.  J.  (1997,  Winter).  Strategic  Eogistics  for  Intervention  Eorces.  Parameters,  42-59. 
Ericker  Jr.,  R.  D.,  &  Robbins,  M.  (2000).  Retooling  for  the  Logistics  Revolution:  Designing 
Marine  Corps  Inventories  to  Support  the  Warfighter  (Document  No.  RB-7535).  Rand 
Corporation. 

Eriedenthal,  S.  (2012).  An  Introduction  to  Model-Based  Systems  Engineering  (MBSE)  using 
SysML.  Troy,  MI:  International  Council  on  Systems  Engineering. 

Eriedenthal,  S.,  Moore,  A.,  Steiner,  R.  (2008).  A  Practical  Guide  to  SysML:  The  Systems 
Modeling  Language.  New  York:  Morgan  Kaufmann  OMG  Press. 


60 


UNCLASSIFIED 


Girardini,  K.  J.,  Lewis,  W.,  Eden,  R.  A.,  Gardner,  E.  S.  (1996).  Establishing  a  Baseline  and 
Reporting  Performance  for  the  Order  and  Ship  Process  (Document  No.  DB-I73-A). 

Rand  Corporation. 

Girardini,  K.J.,  Lackey.  A.  W.,  Peltz,  E.  (2007).  Stockage  Determination  Made  Easy. 
(Document  No.  RP-I272  ).  Rand  Corporation. 

Goldratt,  E.  M.  (1984).  The  Goal.  Great  Barrington,  MA:  North  River  Press. 

Griss,  M.  (2009).  The  Mobile  Companion:  Mobility  Research  in  Silicon  Valley.  Carnegie 

Mellon  University  Center  for  Collaboration  Science  and  Applications  Colloquium  Talks. 
Hachat,  L.,  Willhoft,  M.,  Woody,  A.  (2010).  Net-Centricity  -  Where  is  the  Data?  Ground 
Vehicle  Systems  Engineering  Technology  Symposium,  1-5.  Dearborn,  MI. 

Hatch,  M.  L.,  &  Badinelli,  R.  D.  (1999).  Concurrent  Optimization  in  Designing  for  Logistics 
Support.  European  Journal  of  Operational  Research,  115, 11-91 . 

Heilala,  J.,  Montonen,  J.,  Kivikunnas,  S.,  Jarvinen,  P.,  Maantila,  M.,  Sillanpaa,  J.,  Jokinen,  T. 

(2010).  Developing  Simulation-Based  Decision  Support  Systems  Eor  Customer-Driven 
Manufacturing  Operation  Planning.  Winter  Simulation  Conference,  3363-3375. 

Huntley,  H.  E.  (1970).  The  Divine  Proportion.  New  York:  Dover  Publications,  Inc.. 

Huthwaite,  B.  (2004).  The  Lean  Design  Solution:  a  Practical  Guide  to  Streamlining  Product 
Design  and  Development.  Macinac  Island,  MI:  Institute  for  Lean  Design. 

Jain,  S.,  Choong,  N.  E.,  Aye,  K.  M.,  Luo,  M.  (2001).  Virtual  Eactory:  an  Integrated  Approach  to 
Manufacturing  Systems  Modeling.  Journal  of  Operations  and  Production  Management, 
21,(  5/6),  594-608. 

Jain,  S.,  &  Leong,  S.  (2005).  Stress  Testing  a  Supply  Chain  using  Simulation.  Winter 
Simulation  Conference,  1650-1657. 


61 


UNCLASSIFIED 


Jarvinen,  P.,  Puolamaki,  K.,  Siltanen,  P.,  Ylikerala,  M.  (2009).  Visual  Analytics:  Final  Report. 
VVT  Technical  Research  Centre  of  Finland.  Retrieved  from 
http://www.alphagalileo.org/ViewItem.aspx?ItemId=61314&CultureCode=en 
Kane,  M.,  &  Trochim,  W.  M.  K.  (2010).  Concept  Mapping  for  Planning  and  Evaluation 
(Applied  Social  Research  Methods).  Thousand  Oaks,  CA:  SAGE  Publications,  Inc.. 
Kang,  K.,  &  McDonald,  M.  E.  (2010).  Impact  of  Eogistics  on  Readiness  and  Fife  Cycle  Cost:  A 
Design  of  Experiments  Approach.  Winter  Simulation  Conference,  1336-1346. 

Kaski,  T.  (2002).  Product  Structure  Metrics  as  an  indicator  of  demand-supply  chain  efficiency: 
Case  Study  in  the  Cellular  Networks  Industry  (Doctoral  Dissertation).  Helsinki 
University  of  Technology  Department  of  Industrial  Engineering  and  Management. 

Kaski,  T.,  &  Heikkila,  J.  (2002).  Measuring  Product  Structures  to  Improve  Demand-Supply 
Chain  Performance.  International  Journal  of  Technology  Management,  23,  578-98. 
Kasser,  J.  E.  (2010).  Seven  Systems  Engineering  Myths  and  the  Corresponding  Realities. 
Systems  Engineering  Test  and  Evaluation  Conference,  1-13.  Retrieved  from: 
http://www.academia.edu/949750/Seven_systems_engineering_myths_and_the_correspo 
nding_realities 

Kaymaz,  K.,  &  Eryigit,  K.  Y.  (2011).  Determining  Factors  Hindering  University-Industry 
Collaboration:  An  Analysis  from  the  Perspective  of  Academicians  in  the  Context  of 
Entrepreneurial  Science  Paradigm.  International  Journal  of  Social  Inquiry,  4(1),  185- 
213. 

Kelly,  T.  K.,  Peters,  J.  E.,  Eandree,  E.,  Moore,  E.  R.,  Steeb,  R.,  Martin,  A.  (2011).  The  U.S. 
Combat  and  Tactical  Wheeled  Vehicle  Fleets  Issues  and  Suggestions  for  Congress 
(Document  No.  MG-1093-OSD).  Rand  Corporation. 


62 


UNCLASSIFIED 


Kepner,  C.  H.,  &  Tregoe,  B.  B.  (1965).  The  Rational  Manager.  New  York:  McGraw-Hill. 

Kimmel,  P.  (2005).  UML  Demystified.  New  York:  McGraw-Hill/Osborne. 

Kleijnen,  J.  P.  C.  (2005).  Supply  Chain  Simulation  Tools  and  Techniques:  a  Survey. 

International  Journal  of  Simulation  &  Process  Modeling,  62-89.  Retrieved  from 
http://www.cob.unt.edu/slides/pany/simulation_paper/ijspm.pdf 
Ko,  K.,  Yoo,  S.  K.,  Kim,  B.  H.,  Park,  B.  C.,  Park,  E.  S.  (2010).  Simulation  Based  EAB 
Scheduler:  SEEPEAN®.  Winter  Simulation  Conference,  40-48. 

Eee,  S.,  Eucas,  N.  P.,  Cao,  A.,  Pandya,  A.,  Ellis,  D.  (201 1).  An  Augmented  Reality  UAV- 

Guided  Ground  Navigation  Interface  Improves  Human  Performance  in  Multi-Robot  Tele- 
Operation.  Ground  Vehicle  Systems  Engineering  Technology  Symposium,  1-7, 

Dearborn,  MI. 

Eeydesdorff,  E.,  &  Meyer,  M.  (2006).  Triple  Helix  Indicators  of  Knowledge-based  Innovation 
Systems.  Research  Policy,  35,  1-21.  Retrieved  from 
http://arxiv.org/ftp/arxiv/papers/09 1 1/09 1 1 .3407  .pdf 
Eifton,  J.  (November  7,  2012).  Pentagon  Challenges  Chinese  Monopoly  on  Rare  Earths: 
Commodities.  Bloomberg  Government  Early  Bird.  Retrieved  from 
http://214.14.134.30/ebird/ebfiles/e20121107910236.html 
Eu,  R.,  &  Song,  S.  (2010).  A  Tutorial  on  Concepts  and  Measures  of  Manufacturing  Processes 
Dependence.  Winter  Simulation  Conference,  254-267. 

Euqman,  E.,  &  Griss,  M.  (2010).  Overseer:  A  Mobile  Context-Aware  Collaboration  and  Task 
Management  System  for  Disaster  Response.  International  Conference  on  Creating, 
Connecting,  and  Collaborating  through  Computing. 


63 


UNCLASSIFIED 


Maculley,  K.  (2012).  Army  Capabilities  Integration  Center.  FY  13  Army  Experimentation. 

Slide  3. 

Markel,  M.  (1996).  Technical  Communication:  Situations  and  Strategies.  (4*  ed.).  New  York: 
St.  Martin’s  Press. 

McDowell,  D.,  &  Norcross,  J.  (2010).  The  Use  of  Software  Virtualization  in  Ground  Combat 
Vehicles.  Ground  Vehicle  Systems  Engineering  Technology  Symposium,  1-11, 

Dearborn,  MI. 

Mckone-Sweet,  K.,  &  Yoo-Taek  Lee,  Y.  T.  (2009).  Development  and  Analysis  of  a  Supply 
Chain  Strategy  Taxonomy.  Journal  of  Supply  Chain  Management,  45  (3),  3-24. 
McLeary,  P.  (October  21,  2012).  AUSA:  U.  S.  Army:  Armored  Vehicle  RfP  Coming  This 
Fiscal  Year.  DefenseNews.  Retrieved  from 

http://www.defensenews.eom/article/20121021/DEFREG02/310210005/AUSA-U-S- 
Army-Armored-Vehicle-RfP-Coming-Fiscal-Year 
McLeod,  D.,  &  Mandelbaum,  J.  (2010).  Parts  Management  in  Systems  Engineering.  Defense 
Standardization  Program  Journal,  11-15. 

Mehta,  S.,  &  Cooper,  S.  (201 1).  Hierarchal  Platforms-Based  Design  of  Ground  Vehicles. 

Ground  Vehicle  Systems  Engineering  Technology  Symposium,  1-11,  Dearborn,  MI. 
Mendonza,  P.  &  Fitch,  J.  A.  (2012).  Decision  Management  (DM)  as  the  Engine  for  Scalable 

Cross  Domain  Systems  Engineering  (SE).  International  Symposium  of  the  International 
Council  on  Systems  Engineering,  1-14,  Rome. 

Mendonza,  P.  &  Fitch,  J.  A.  (2011).  Object  Based  Systems  Engineering.  National  Defense 
Industry  Association  Systems  Engineering  Conference,  1-13,  San  Diego,  CA. 


64 


UNCLASSIFIED 


Mendonza,  P.  (2012).  The  TARDEC  Advanced  Systems  Engineering  Capability  (ASEC). 

Ground  Vehicle  Systems  Engineering  Technology  Symposium,  1-6,  Dearborn,  ML 
Middleton,  V.  E.  (2010).  Simulating  Small  Unit  Military  Operations  With  Agent-Based  Models 
of  Complex  Adaptive  Systems.  Winter  Simulation  Conference,  1 19-134. 

Milgram,  P.,  Zhai,  S.,  Drasic,  D.,  Grodski,  J.  J.  (1993).  Applications  of  Augmented  Reality  for 
Human-Robot  Communication.  Proceedings  of  International  Conference  on  Intelligent 
Robotics  and  Systems  1467-1472. 

Military  Standard  (MIE-STD)  499B,  Systems  Engineering,  Draft  (DoD  6  May  1994). 

Monczka,  R.  M.,  Handfield,  R.  B.,  Giunipero,  E.  C.,  Patterson,  J.  E.  (2011).  Purchasing  and 
Supply  Chain  Management.  Boston:  South-Western  CollegeAVest. 

Narasimhan,  R.,  Kim,  S.  W.,  Tan,  K.  C.  (2008).  An  Empirical  Investigation  of  Supply  Chain 
Strategy  Typologies  and  Relationships  to  Performance.  International  Journal  of 
Production  Research,  46  (18),  5231-5259. 

National  Defense  Industrial  Association.  (201 1).  Pinal  Report  of  the  Model  Based  Engineering 
(MBE)  Subcommittee.  1-58.  Retrieved  from: 

http://www.ndia.org/Divisions/Divisions/SystemsEngineering/Documents/Committees/M_S%20Committe 
e/Reports/MBE_Final_Report_Document_(20 1 1  -04-22)_Marked_Einal_Draft.pdf 
Newman,  D.  G.  (1996).  Engineering  Economic  Analysis  (6*  ed.).  San  Jose,  CA:  Engineering 
Press. 

Noone,  Jr.,  M.  P.  (1978).  The  Military -Industrial  Complex  Revisited.  Air  University  Review, 
1-4.  Retrieved  from: 

http  ://w  w  w .  airpower  .maxwell .  af .  mil/airchronicles/aureview/ 197 8/nov  -dec/noone .  html 
Office  of  the  Assistant  Secretary  of  the  Army  Acquisition  Eogistics  and  Technology. 
Implementation  of  Economic  Useful  Life.  (DA,  April  22,  2012). 


65 


UNCLASSIFIED 


Office  of  the  Deputy  Assistant  Secretary  of  Defense  for  Supply  Chain  Integration.  (2012). 

Supply  Chain  Integration.  Retrieved  from  http://www.acq.osd.mil/log/sci/index.htm 
Office  of  the  Secretary  of  Defense.  (2012).  Manufacturing  and  Industrial  Base  Policy. 

Retrieved  from  http://www.acq.osd.mil/mibp/index.shtml 
Opdyke,  W.  F.  (1992).  Refactoring  Object-Oriented  Frameworks  (Doctoral  Dissertation). 

University  of  Illinois  at  Urbana-Champaign  Department  of  Computer  Science. 

Ortland,  R.  J.,  Bissonnette,  L.  A.,  Miller,  D.  R.  (2010).  Application  of  Data  Mining  and 

Analysis  to  Assess  Military  Ground  Vehicle  Components.  Ground  Vehicle  Systems 
Engineering  Technology  Symposium,  1-18,  Dearborn,  MI. 

Paju,  M.,  Leong,  S.,  Heilala,  J.,  Johansson,  B.,  Lyons,  K.,  Heikkila,  A.,  Hentula,  M.  (2010). 
Framework  and  Indicators  for  a  Sustainable  Manufacturing  Mapping  Methodology. 
Winter  Simulation  Conference,  3411-3422. 

Palmer,  G.  J.  (1996).  A  simulated  annealing  approach  to  integrated  production 
Scheduling.  Journal  of  Intelligent  Manufacturing,  7(3),  163-176. 

Panwalkar,  S.  S.,  &  Iskander,  W.  (1977).  A  survey  of  scheduling  rules.  Operations  Research 
Society  of  America,  25  (1),  45-61. 

Pastrana,  J.,  Marin,  M.,  Mendizabal,  C.,  Helal,  M.  (2010).  Enterprise  Scheduling:  Hybrid, 
Feedback,  and  Hierarchical  Issues.  Winter  Simulation  Conference,  3350-3362. 

Patria,  G.  S.  (2000).  Productive  Job  Shop  Scheduling  using  Simulation.  Pacific  Conference  on 
Manufacturing,  18-24,  Southfield,  MI. 

Patria,  G.  S.  (2010,  Summer).  Systems  Engineers  Optimize.  Accelerate,  66-68. 

Patria,  G.  S.,  Bean,  J.,  McCauley,  R.  (2012,  February).  Long-Range  Perspective.  Accelerate, 
59-62. 


66 


UNCLASSIFIED 


Peltz,  E.,  Robbins,  M.  E.,  Boren,  P.  M.,  Wolff,  M.  (1968).  Diagnosing  the  Army’s  Equipment 
Readiness  The  Equipment  Downtime  Analyzer  (Document  No.  MR-1481-A).  Rand 
Corporation. 

Peng,  Y.,  Einin,  T.,  Eabrou,  Y.,  Cost,  R.  S.,  Chu,  B.,  Eong,  J.,  Tolone,  W.  J.,  Boughannam,  A. 
(1999).  An  Agent-Based  Approach  for  Manufacturing  Integration  -  The  CIIMPEEX 
Experience.  Journal  of  Applied  Artificial  Intelligence,  id  (i -2),  39-44.  Retrieved  from: 
http://www.learningace.eom/doc/5427304/bla53be8fa9d4418ab69df5e0d070974/aai-ciimplex 

Pema,  G.  E.  (2011,  March).  Sustaining  the  Responsible  Drawdown  of  Eorces.  Army 
Sustainment. 

Persson,  E.  (2003).  Supply  Chain  Simulation:  Experiences  from  Two  Case  Studies.  European 
Simulation  Symposium.  Retrieved  from 
http://www.scs-europe.net/services/ess2003/PDE/MANE17.pdf 

Persson,  E.,  &  Olhager,  J.  (2002).  Performance  Simulation  of  Supply  Chain  Designs. 
International  Journal  of  Production  Economics,  77,  231-45. 

Peterson,  T.  A.  (2010).  Eeveraging  INCOSE  Resources  to  Identify  Systems  Engineering  Best 
Practices.  Ground  Vehicle  Systems  Engineering  Technology  Symposium,  1-8, 

Dearborn,  MI. 

Pilemalm,  S.,  Hallberg,  N.,  Sparf,  M.,  Niclason,  T.  (2012).  Practical  Experiences  of  Model- 
Based  Development:  Case  Studies  from  the  Swedish  Armed  Eorces.  Systems 
Engineering,  15  (4),  407-421. 

Pokorny,  R.,  Chambers,  S.,  Olson,  R.,  Rhyne,  R.  (2011).  Parts  Management  the  Technicalities 
of  Data  Sharing.  Defense  Standardization  Program  Journal,  16-24. 

Press,  W.  H.,  Teukolsky,  S.  A.,  Vetterling,  W.  T.,  Elannery,  B.  P.  (1992).  Numerical  recipes  in 
C:  The  art  of  scientific  computing.  Cambridge:  Cambridge  University  Press. 


67 


UNCLASSIFIED 


Rand,  Ay n.  (1957).  Atlas  Shrugged.  New  York:  Random  House. 

Rand  Corporation.  (2012).  Government-Wide  and  DOD  Definitions  of  R&D.  Retrieved  from 
http://www.rand.org/content/dam/rand/pubs/monograph_reports/MRl  1 94/MR  1 194.appb.  pdf 

Richter,  K.,  &  Bauer,  E.  (2010).  The  Synergies  of  DoD  Systems  Engineering  and  International 
Standards.  Defense  Standardization  Program  Journal,  3-10. 

Ries,  A.  J.,  Eance,  B.,  Sajda,  P.  (2011).  Eeveraging  Brain  Computer  Integration  Technologies 
for  Military  Applications.  Ground  Vehicle  Systems  Engineering  Technology  Symposium, 
1-6,  Dearborn,  MI. 

Robbins,  M.  E.,  Boren,  P.  M.,  Eden,  R.  A.,  Relies,  D.  A.  (1998).  Measurement  ofUSMC 

Logistics  Processes:  Creating  a  Baseline  to  Support  Precision  Logistics  Implementation 
(Document  No.  DB-235-USMC).  Rand  Corporation. 

Rolland,  J.  P.,  &  Euchs,  H.  (2000).  Optical  Versus  Video  See-Through  Head-Mounted  Displays 
in  Medical  Visualization.  MIT  Press  Journals:  Teleoperators  and  Virtual  Environments, 
9(3),  287-309. 

Roy,  M.  V.  (201 1).  Portable  Displays  and  Controls  for  Vehicle  Dismounted  Operations. 

Ground  Vehicle  Systems  Engineering  Technology  Symposium,  1-4,  Dearborn,  MI. 

Samson,  E.  P.  &  Peterson,  T.  A.  (2010).  A  Systems  Engineering  and  Integration  Methodology 
for  Complex  Systems.  Ground  Vehicle  Systems  Engineering  Technology  Symposium,  1- 
8,  Dearborn,  MI. 

Sargent  Jr.,  J.  E.  (2012).  Eederal  Research  and  Development  Eunding: 

EY2013.  Retrieved  from  http://www.fas.org/sgp/crs/misc/R42410.pdf 


68 


UNCLASSIFIED 


Saylor,  K.  J.,  Meyer,  C.  F.,  Wilmes,  T.,  Moore,  M.  S.  (2011).  Advaneed  Situational  Awareness 
-  Modeling  and  Visualization  Environment.  Ground  Vehicle  Systems  Engineering 
Technology  Symposium,  1-6,  Dearborn,  MI. 

Sehmitt,  A.  J.  (2009).  Quantifying  Supply  Chain  Disruption  Risk  using  Monte  Carlo  and 

Diserete-Event  Simulation.  Winter  Simulation  Conference,  1237-1248.  Retrieved  from: 
http://dspace.mit.edu/handle/1721 . 1/6028 1 

Schneider,  M.  S.  (1994).  A  Beginner’s  Guide  to  Constructing  the  Universe.  New  York: 
HarperCollins  Publishers. 

Schwarz,  E.,  &  Weng,  Z.  K.  (2000).  The  Design  of  a  JIT  Supply  Chain:  the  Effect  of  Eeadtime 
Uncertainty  on  Safety  Stock.  Journal  of  Business  Logistics,  21(2),  231-253. 

Shapiro,  J.  F.  (2001).  Modeling  the  Supply  Chain.  North  Scituate,  Massachusetts:  Duxbury 
Press. 

Shenkus,  R.,  &  Sloss,  D.  (2010).  Effective  Strategic  Planning  Workshop.  Eecture  Notes. 

United  States  Army  Tank  Automotive  Research,  Development  and  Engineering  Center. 

Stefanopoulou,  A.  (2010).  U.S.  Army  Automotive  Research  Center  (ARC).  Eecture  Notes. 

United  States  Army  Tank  Automotive  Research,  Development  and  Engineering  Center. 

Steiner,  S.  H.,  MacKay,  R.  J.,  Ramberg,  J.  S.  (2008).  An  Overview  of  the  Shainin  System  for 
Quality  Improvement.  University  of  Waterloo. 

St.  Onge  Supply  Chain  Engineering.  (2012).  Retrieved  from: 

www.stonge.com/what_we_do/supply_chain_strategy/logistics_network_optimization 
Sturrock,  D.  (2010).  Tips  For  Successful  Practice  of  Simulation.  Winter  Simulation 
Conference,  87-94. 

Taraman,  K.  (2010).  Strategic  Planning.  Eecture  Notes.  Eawrence  Technological  University. 


69 


UNCLASSIFIED 


TARDEC  GI.  (2010).  TARDEC  Human  Capital  Strategy.  Warren,  ML 

Taylor,  D.  A.  (1990).  Object-Oriented  Technology:  A  Manager’s  Guide.  New  York:  Addison- 
Wesley  Publishing  Company. 

Terzi,  S.,  &  Cav alien,  S.  (2004).  Simulation  in  the  Supply  Chain  Context:  a  Survey. 

Computers  in  Industry,  53(1),  3-16. 

Thompson,  C.  &  Einigan,  D.  (2010).  An  Improved  Process  for  Incorporation  of  Design  for 
Supportability.  Ground  Vehicle  Systems  Engineering  Technology  Symposium,  1-13, 
Dearborn,  ML 

Thompson,  D.  C.  (2010).  RS  JPO  Initiatives  and  Programs.  Ground  Vehicle  Systems 
Engineering  Technology  Symposium,  Dearborn,  ML 

Thurston,  M.,  Haselkorn,  M.,  Nasr,  N.  (2011).  Integrating  Life-Cycle  Planning  Considerations 
into  Design  through  the  Innovation  Based  Design  Process.  Ground  Vehicle  Systems 
Engineering  Technology  Symposium,  1-11,  Dearborn,  ML 

Tian,  Q.,  Zhong,  Y.,  Xiao,  R.,  Du,  Y.,  Yang,  H.  (2010).  The  Study  and  Application  of 

Integrating  Axiomatic  Design  and  TRIZ  for  Conceptual  Design.  International  Journal  of 
CAD/CAM,  10  (1).  Retrieved  from: 
http://www.ijcc.Org/ojs/index.php/ijcc/article/view/9/l  1 1 

Tolone,  W.  J.  (2000).  Virtual  Situation  Rooms:  Connecting  People  Across  Enterprises  for 
Supply-Chain  Agility.  Computer-Aided  Design,  32,  109-117. 

Trienekens,  J.  H.,  &  Hvolby,  H.  -H.  (2001).  Models  for  Supply  Chain  Reengineering. 
Production  Planning  &  Control,  12  (3),  254-264. 

Wang,  M.  Y.  D.  (2000).  Speeding  the  Elow:  How  the  Army  Cut  Order-and-Ship  Time 
(Document  No.  RB-3006).  Rand  Corporation. 


70 


UNCLASSIFIED 


Wang,  X.,  &  Dunston,  P.  S.  (2006).  Groupware  Concepts  for  Augmented  Reality  Mediated 
Human-to-Human  Collaboration.  Joint  International  Conference  on  Computing  and 
Decision  Making  in  Civil  and  Building  Engineering,  1836-1842,  Montreal. 

Wang,  X.,  &  Dunston,  P.  S.  (2009).  Mixed  Reality-based  Collaborative  Virtual  Environments 
(Grant  No.  CMS-0239091).  National  Science  Foundation. 

Weber,  C.,  Current,  J.,  Desai,  A.  (2000).  An  Optimization  Approach  to  Determining  the 

Number  of  Vendors  to  Employ.  Supply  Chain  Management:  an  International  Journal, 
5(2),  90-98. 

Williams,  R.  (2010).  Joint  Ground  Robotics  Enterprise  Perspective.  Ground  Vehicle  Systems 
Engineering  Technology  Symposium,  Dearborn,  MI. 

Woody,  A.,  &  Hoff,  C.  (2010).  Timing  is  Everything,  and  a  Picture  is  Worth  a  Thousand 

Words.  Ground  Vehicle  Systems  Engineering  Technology  Symposium,  1-7,  Dearborn, 

MI. 

Yu,  C.  -S.,  &  Ei,  H.  -E.  (2000).  A  Robust  Optimization  Model  for  Stochastic  Eogistic 
Problems.  International  Journal  of  Production  Economics,  64,  385-397. 


Disclaimer:  Reference  herein  to  any  specific  commercial  company,  product,  process,  or  service 
by  trade  name,  trademark  manufacturer,  or  otherwise  does  not  necessarily  constitute  or  imply  its 
endorsement,  recommendation,  or  favoring  by  the  United  States  Government  or  the  Department 
of  the  Army  (DA).  The  opinions  of  the  authors  expressed  herein  do  not  necessarily  state  or 
reflect  those  of  the  United  States  Government  or  the  DA,  and  shall  not  be  used  for  advertising  or 
product  endorsement  purposes. 


71 


UNCLASSIFIED 


Appendix  A 

Cambridge  University  Press 

Tank  Automotive  Research  Development  and  Engineering  Center 
Assistant  Secretary  of  the  Army  for  Acquisition,  Eogistics,  and  Technology 
Swiss  Eederal  Institute  of  Technology 
University  of  Illinois 

Journal  of  Supply  Chain  Management  (ISM) 

Purchasing  Management  Association  of  Canada  (PMAC) 

National  Association  of  Purchasing  Agents  (NAPA) 

VVT  Technical  Research  Centre  of  Einland 
National  Institute  of  Governmental  Purchasing  (NIGP) 

Rand  Corporation  Publications 
American  Society  for  Quality  (ASQ) 

Association  for  Computing  Machinery  (QUEUE) 

National  Science  Eoundation  (NSE) 

Defense  Standardization  Program  Journal 


72 


UNCLASSIFIED 


Production  &  Inventory  Management  (P&IM)  Journal  -  Association  for  Operations  Management 
(APICS) 

Journal  of  Engineering  for  Industry 
International  Journal  of  Production  Research  (IJPR) 

Social  Science  Information 

Council  of  Supply  Chain  Management  Professionals  (CSCMP) 

United  Nations  Conference  on  Trade  and  Development  (UNCTAD) 

Journal  of  Computational  Physics 
Winter  Simulation  Conference  (WSC) 

Computer-Aided  Design 

Army  Sustainment  (Army  Eogistician) 

International  Journal  of  Systems  Science 

Parameters 

Association  for  Unmanned  Vehicle  Systems  International  (AUVSI) 

Research  Policy 

Industrial  Robot:  an  International  Journal 
Armed  Eorces  &  Society 

International  Journal  of  Production  and  Economics 


73 


UNCLASSIFIED 


European  Journal  of  Operational  Research 
International  Journal  of  Computer  Applications 
Journal  of  Business  Eogistics 
Journal  of  Operations  Management  (JOM) 

International  Test  and  Evaluation  Association  (ITEA) 

International  Journal  of  Robotics  Research 
Journal  of  Robotics  Association  of  Japan 
IEEE  Robotics  and  Automation  Society 
Journal  of  Automotive  Engineering 

International  Eederation  of  Purchasing  and  Supply  Chain  Management  (lEPSM) 

Journal  of  Intelligent  and  Euzzy  Systems 

International  Journal  of  Robotics  and  Automation 

International  Symposium  on  Robotics  and  Manufacturing 

Center  for  Advanced  Purchasing  Studies  (CAPS) 

International  Journal  of  Technology  Management  (IJTM) 

AMR  Research,  Inc. 

Voluntary  Inter-Industry  Commerce  Standards  Organization  (VIICSO) 


74 


UNCLASSIFIED 


International  Journal  of  Approximate  Reasoning 

International  Journal  of  Engineering  Applications  of  Artificial  Intelligence 
International  Conference  on  Intelligent  Robotics  and  Systems  (lEEE/RSJ) 

Journal  of  Systems  Engineering  (INCOSE) 

Journal  of  Intelligent  Manufacturing 

Journal  of  Manufacturing  Technology  Management  (JMTM) 

Pacific  Conference  on  Manufacturing  (PCM) 

Systems  Engineering  Society  of  Australia  (SESA) 

Journal  of  Strategic  Information  Systems 

International  Purchasing  and  Supply  Education  and  Research  Association  (IPSERA) 
MIT  Press  Journals:  Teleoperators  and  Virtual  Environments 
Journal  of  Intelligent  Automation  and  Soft  Computing  (AutoSoft) 

Intelligent  Autonomous  Systems  Society 
IEEE  International  Conference  on  Euzzy  Systems 
Association  of  Autonomous  Astronauts 
World  Trade  Organization  (WTO) 

Institute  for  Operations  Research  and  the  Management  Sciences  (INEORMS) 


75 


UNCLASSIFIED 


Joint  International  Conference  on  Computing  and  Decision  Making  in  Civil  and  Building 
Engineering 

International  Journal  of  Intelligent  Systems 
lEEE/ASME  Transactions  on  Mechatronics 
Supply  Chain  Council  (SCC) 

International  Journal  of  Intelligent  Control  and  Systems 
Journal  of  Autonomous  Agents  and  Multi  Agent  Systems 
Journal  of  Battlefield  Technology 

International  Symposium  on  Mixed  and  Augmented  Reality 

Nielsen  Norman  Group 

EECOMS 

Pixel  -  New  Perspectives  in  Science  Education 

Journal  of  Automation,  Mobile  Robotics  &  Intelligent  Systems 

Eogistics  and  Supply  Chain  Management  Society  (ISCMS) 

International  Journal  of  CAD/CAM  (IJCC) 

International  Journal  of  Vehicle  Autonomous  Systems 

Journal  of  Applied  Artificial  Intelligence 

International  Research  Study  of  Public  Procurement  (IRSPP) 


76 


UNCLASSIFIED 


International  Conference  on  Creating,  Connecting,  and  Collaborating  through  Computing 

International  Journal  of  Advanced  Robotic  Systems 

International  Journal  of  Intelligent  Information  Technologies 

International  Journal  of  Simulation  &  Process  Modeling 

Journal  of  Field  Robotics 

Journal  of  Intelligent  Transportation  Systems 

International  Journal  of  Marine  Navigation  and  Safety  of  Sea  Transportation  (TRANSNAV) 
International  Journal  of  Autonomous  and  Adaptive  Communications 
International  Journal  of  Intelligent  Computing  and  Cybernetics 
Journal  of  Operations  and  Supply  Chain  Management  (JOSCM) 

International  Journal  of  Social  Inquiry  (IJSI) 

International  Journal  of  Intelligent  Systems  and  Applications 
Ground  Vehicle  Systems  Engineering  Technology  Symposium 

Carnegie  Mellon  Univ.  Center  for  Collaboration  Science  and  Applications  Colloquium  Talks 
International  Journal  of  Intelligent  Computing 
International  Society  of  Intelligent  Unmanned  Systems 


77 


UNCLASSIFIED 


Journal  of  Aerospace  Engineering  Electrification  of  Aircraft  Systems  -  Power  and  Control 
International  Journal  of  Intelligent  Unmanned  Systems 


78 


UNCLASSIFIED 


Appendix  B 


coVSv^uWfrvot^ 

^  i  * 

«S  y^todowi  Kx«  revol  >A‘V*or»rt€.o  p\aKU^ac:K>< ’»rw^  vto-  a. 

^  -  ^<v^-fc|**  "Of  *  n^rN  '  «rK^jnc<-/in •**  inaJUMtA>^  f 

a  <.vck>i W«vV  cio»a\  io.  . 


ii«.  in^t' 


f*  «oV>Arv.cc 


TOCAi 


sj  «0  _ 

ikaa^  ^l  :nStK«vi- oirod”t'€'i(!5»rt.x» 


^  •  WA.  Cl  v«  AT  i  o*s» 

k/^AC  <3S  lO.b.^ 

"“  '  ' 

r. 

l.(o4>H% 

*  4 

4 

t 

• 

•  • 

• 

yjcooe.  vki 

>y  lSiMq*^ 

iVi  Ckbovd  fw-ds  «  kx^Hif  aj»vy«^f?-  t 

13  OiA^Sou-rcc.^  -V*  II^iA/cKhvA  . 

(-#fv\(JoiQcl^  wh'II  *A.  -WKi^  rvto.Aa'^trruft.rvV 

y  *  '"t  A  A.  \‘»*^  c^oi'v^  »3  P^*-^rv“V|/Y»  ^ 

l^9.c^,  ,  ^®)f%  <>»»'  ■'"•  ("t  li  ^bctt  z'  •-/ 

"fKt.  b«s-'‘  »  i  ^  J  _  »  •: 

Ai-'-  x/oM  HAv^  1^  i  »viu«=l^ 

re-Vc^-Vjo'^  ^  >zv. ;'tVv 

*  fe  * 

rvsr 

T\«V'C. 

^  .  *  . 


ji 

o< 


79 


UNCLASSIFIED 


t/(^fzo\z  -  '^  i 


UNCLASSIFIED 


^  .  %rM«T  you 

'*  AC^yo^*- 

CA£»4  CWu9«|0E>  rwi^CT  m.u~trr  7 

_  ,,  •  A.as' • 


u>< 

/A>Se55liJ6i. 

Wtf.iT  ifv(r 


Arr.W*^'  ^.4Ai»A#K 

htf  TW\TW.»TVx4r 

I  SW^tV  ? 


,  ru: 

tfwUM 

ns  • 


» 

I 

•trf**.  y»r*  “vwiutr  AM  y«t4 
<it»^  •  • 

•  rr»  -nie  t^AT 

u«tfO  tatsAMAArv^ 
- _  Tf  m  erf»*’€K^  Wimaimv 


^  vTtfra^  g*i  t-»ngieAT\v€  cc wHgg^. 


^  -* - 


-il. 


n*ATOMi«AHtU 


81 


UNCLASSIFIED 


83 


UNCLASSIFIED 


UNCLASSIFIED 


TV1|5  POkAA.  KTVoOev  .s  »o«yETV|l«^  il^AT  NKVOa  To  I 

W  rL<*v(BO  W.™  ;  ..  ,^0Ofp‘. 


AE4tUwTS  tMe  WUAT  TKlNCa 
fteMujc 

lVe  izUfoKTTHil^t 

Bnf=o#?r 


fun*-  '  ♦■C  ^^CUvTS  CoMV-O  '^^VjREr  >A^ajk)ClM^  ©I'/ 

t>ilb  rve^iu».  1Vt)A^C.  -  ytyuCfie.  tt/  THC  I^LAC^ . 


3d  PdCAR  PLc 


>  V' 


At.»a 


E»^*>V*C 
l»«  M* 'rM:l>LP’ 

AUT 
i»X*>  j»^ 

A«TajriWkic. 

IUv6 


.-  MVXJk  Ol? 
i5  kX 


>  OAWA»>l»ATi»f^ 

cmaM  of  eexwkM#H<^ 

tmC  «M.(«f£  CASCA«<E<)  (auw^C 
TXAT  rMC>  TH«-  CkAiw  Of 

fW*^  ^'tVK.  <T  &u>*«i 


Q-  CA^/  C»UtAecp^T»0«^  OCC'-'S.  ^CtwC^v'  AAf^ltJ 

That  Ai>£-  o«-  Oip^pcv-tt  ucv^« 

Xe  Ld  \_  c  A  R.fr(\9f 

TWI'V  PVCTA  fiS  4*^ 

<»p  -Ta^cnoL^  v»- 


L^i^klAk  ^RatfAArMiMiftfO-  'v^A#v(iUA<^  L  V 


COKJl^\0*^ 


85 


UNCLASSIFIED 


oFo^J  a  eiUU'iSflllitBEr^  |  ive 
mo09\^  yvo\j(u>  uiKe  ^  ^ 


_i_».  -li 


I  •  •' 

r  ;  r—  1 


^ — -mus  , 


•  •  i» 


TMr  <30««Vv 

AM#C@  «*<  *  O 


^®Ns^  '' '  i 

♦  ^#'1  ^  fi  — 


-t 


';'^.\^v  ' 


J 


\ - 

.  '  A  i  f  ■*  ■  Ik  . 


•1  ^  1  r 


►  # 


A'-'.* 


86 


UNCLASSIFIED 


I m 


13 


IF^WICJ  At^eACy  T*  IHCC  w4AT  ixey**.*  ^#»X4ffc4»  — 

OH  j  T>4i5  »i  |k*«T’  fiB-ifJ-TW-aiW  ^  ni  j=5»* - 

«>N«Ayw«Atr^  C  5Vtt«YO*-«*^  Tf#A 

«t«tT 


t^AAiAttdM  *)»>«  W*M>  ^A^Pt«/avTAtlu%j5  lAiCt-  «e  -TMt  CtUU.e^'C^ . 


r 


(tK 

I  _-^  HfcMT 
- : _ * 


*  •»■ 


-\  /• 
I 


A  - 


Ay>*CUTl5* 

•  »*AT  VWW^Uttl'U  O 


|g<.Tv.s/g  ' 


oat)mc^  00CK  'Ttf  ^  L  A w  ^rafL? 

IWjr  A  €At»cri^  4^C4$iaAy  «.u<»uU>  <?»«/  a  5t»v»«D«? 

V^0F«./)yr^  ^  <^J»rWeA.  rWAN  oiv  4A<^  LtA*yi^ 

Oy^fjBL-r^o^ .  Gy  ®<>U4ULy  AA^ 

.  ^•JJt^Tiv'eVy  T0  AL*^  fA  SAt»&ty  CA0</ A^tP 


.  _ ^ _ -  -  ,  . .  1  .  ,  „_ 

|»C*Ac  ,  ■iv-tAACT  -rweixw  f»  A  F»A»WFy«'*P4<.  F#*  lA/OlWObAuf  . 

jiAO  fMfciA  ^VWAICA  I?  PCfdtl^P .  |A»  ^ - 

c*ce«  ^‘n*arw^  Mo60i^r  ^  Ao^i  yektfr-  jacaufs 
|#u5^eAu.  11'  A»v'r  Af  A  Ac.c^Tio^rti(P 

/A^>  THf  5Yat^^  /a<  _ 

iiftigz  A«^ct/-re  FCACD04<s  pwA.<‘®»-^c-“i'Vv'BeBA^Firf 


87 


UNCLASSIFIED 


<  « 


u 


T9#IC  D 
*■ 

T«#K.  e 

A 


yC  ;4  X 


> 

*■-  » 


r- 

1wFi«-  • 

eAo  ? 

6i*  ^tk-iu^  tr  Cec»-A6*AAT\»*J.  ATTB^nAc] 

— ^  o«\.v  f^-nue^ 

r^iAiop  ?  • 

^  c#tiLoN4P(  y^Av* 

it  A'-'-  ««lv»PV4''r6*^  UAW^ 


CT.*>#<3»"T  faoTk»-0^ 
cCA^^^^  rt  t*  o/V* 

•fHt  C*.*4®  VxKACT  UBKA^ 
cci>V‘t>M[r  fA^ay-ATfe  *»MC  viATOAc 

,4MAcaib  C</<.iLPeoAAT>iVlS 

CM>vJOAeT\vny 


I 

f^g,  veiktKAc  ro«wCft  l.i*^5  A<^4# 

f^JfUOUJO.  ^tlMAlM<  »A  wA1*«.'PX'-‘-S' 


0$c  Tm^  511.  ^ttUATiot^  AS  A»^  fcCAtVkPV-^  s 

V>^X«LI^A'*T  VUXVC  AC«V>T  TWCA^ 

il^  M.*#cn-or-  "T  VVK^  OS' 


88 


UNCLASSIFIED 


15 


Oic^Ccr/T... 


if’i^otuCcAtxJ  y*Ok  aM>  waAry*u'l2{'  e^, 

cvit  oe  YiniC  UoAt?  t^g0  urtdAO  TWAT  VTCftiA^  T* 

"lo  uAnr’et  v-tf<sic  N^eonu 


VWw  t  Ahy  Wt  i»y;C««4'c4LAT^  Aa.'  ClV/^oy^CU  fQSuiViC:  .<u»T# 
THt  ? 


^HAT  y(W  l,  (ic^  ^  Al"  THft  •^«v«^f|krT^ 


T^^•  rTPjL 


v«»4/iT  yfc7o 'A6  ^uaT  »S 

(»Oa«>  AT 


A<-Ajfy  ^  TWeqg  A'-‘-  (B^AATiv^  ^  B«^ettALuy  y^<H•T  v«aj 

U.»«o  AT 


\/vaAT  >tT  HAS  2  JMTr»-*-T'  woAcoY: 


PiMrTxL^ 

n-ATVtaKJV5 


1.  y«#t«AT  that  l5  ^Itw >1  •t.^ovO 

1.  */v'-«T  yoy'ftf  Cmot  At  Tv»Arv*Aj’0  »c~  A  Foi-t  r^lomrr 


AmVAiCAr'  TIAC4<»«Ot,A»V  AM7  10 
eA4.A^^ATlA/Sl  fTATieoj 


^  C.*' AAf  A<»  Ta»‘-<9’ 

TV^’lAfe  •#✓ 
^W  OATAr 


t)fieV^»^AL.  ^  TBt*4KOl_0Csy  ^-CCMmCt'Iw  u**-*®.  6^  F*<'£-y 

A^^u<v.-w»  AtvgASfc-  CATinpo  m»r  fvUrf  Tnfe  f»mu»u  |t*  P  •-'icAA^tfF 


89 


UNCLASSIFIED 


16 

’ 

A^jof  r>4^ici>«</Tt<g  ^A/0r  aa/ onruc* 

/  U *!•»«<►  #  ..-•  -^rm  j»TL<*J 

»  ^ - W  ^  ^  W  J 

1  ~~  ^  ^  ^ 

WV^T"'' 

k 

LCvC»AVll^«»'_  THfr  ‘I  C'^50  ,  ^SlGrtsJ 

1. 

>S  A  r(tA»y»0<A<PK|C  ZC'wxjt^^J^  r* 

C»»>f*i  7 

^^CfM.in^e>^  AiA>  A/BeoCO  ? 

AfStsr.  •P  a^re*^  »wi 

_ _ uAf»0«RT  •  o««s»4« 

'  4«Mfr  P«tfCZo«^  A(^4M<oM?  MkAva«illA\pl*C. 

_  aWma.  Of-  YMk  f  •«<»«■  K  >M«irt»  ti^iC.  K^ioa 

_  ♦♦r  fM^V 

AM#C^  c^»9PA  •  Jkt">rwc  ^AXBsS  GtttfC  tK.*#*.c4^  tPPitjeP. 
_ !,  ;  PQCM.vm/T'j  •«  S>T 


90 


UNCLASSIFIED 


17 

'  ^  • . (alUUWCfllUtiKA^T  CATCV^AV 

A.  T*.<ac.  It  «c  c^ixoca^  th.  -T*4» 

nAtfSt  E^«n\t?ivrAV  A  >^fC»ftCrA«t 


SP'CcifiiCl  wKitf  yoU*AA  QPi*rU  AIUkT 
Bvcr  Twf  4«A».0<KA«»^  tfF  ^oir^o.  ^IIAT  cpXO 

f^r€#.*Ti4ci.y  <^e  >.  c-v^Aa/«iATi*»^.ptf  Y 

e  8 

-I  ^•  * 


-wMAT  MA«w^  HAvlh/(M  EAiCU  #c«.»i-»y  A«^  or^  A. 

?  *  -  ■- 


>Mowit.O*i‘T  •.^«reD 
AVw  T#  (a*  A1 

AC|S>C£  C^v.v.^AoAA't.  ap^ 

^_»fcKr  AuUsS  pp/  . 


91 


UNCLASSIFIED 


18 

A««ur  .tf^xfAr*  or  a _ vati^  tjo<»tc 

'{•a  JuyC  A  o*rr  /'.rr  rr>opew  r  ^ 


4  o»*-< n-fT^/tvy  vtV#*  nt'  tc  f  1 

TWfc  «x*  t  -  -r^v^c  "1 


•  A 

TJ*  CAO  TfcAfVtf  cAW  Ju-wT  c*fV-«^0  €ufvA.TP«-  9fr«cM  CTTmAlj 
^  y<AitVi€^  ro£.  To  ^o9  P<a«v^  rvvte^r/  ^ 

<9e#MiK»  CAUUA^#PAP<?*^ 


J 

- 

J 

92 


UNCLASSIFIED 


'  ..  19 

»  A#our  Af^ivy  PlA(fl^Alv^  apf  ^ 

•  ♦ 

yv)Wv,  S^4C'<^»y^  tA'ne*-oX4«?^  TXAT  OT**€fiS  AAm-  t 
fe_4.^^'PM<rtW  To  A<V(>ec\AtlS:'  CAfi^TiCS  ^  i>iA<&MioMAx,Ot(/T.^ 


^  '—•^T  A6(7>-4r  0»»«fc»J  ^TCucTURS-  mATVZM  ^  p^JNC^  T» 

•  1.  A^^AAUve  fVi«T»j>e«£»4  iPi  .*.’ 


A  &  C  p 

e  F'  <a 

A 

0 

•i:  >x: 

c. 

X 

\ 

> 

« 

Si^p  "TVie 

c? 

?< 

H^*  Ul*>f0 

# 

T««TMftTHt<l.  Aivior 

■me-  uenvAff  4»l>--Tvrs;^ 

fVjAnv^  "me 

«4^*  Ci<vC  TW  VO 
yv^^S.  C»€.,  »r 
To  ffJCL  THB  {.IVICE: 
t-»\vC.rJ 

^  _  _ 


93 


UNCLASSIFIED 


A  VUt  Cef>Ta«OS  ot  IT^  f>t^A«trrvlE»/r5  ^  tT 

B  Ia  I  i  -THOUAWT  or  AS  A#^  |N\€AS€ 

.  "  •  ^  «  .  FCflw  ?  »  • 


i»wwVt» 

ecAO' 

rAiu«^ 


«»{«^An«i»  «  TOfcgrTfieA  AT 

Tf#  -rtf  -r»«  MC  AtlTi  TO  TMt 

‘^*’  LIAC  Piyi«/^  QVvv'fV 

^AVnS<  Aop  'SUy'' 


B8Cr 


issoei 

•.i4AiK'«r  *c»tvviuAfsK7  Vo\>>.P 
to  Cf'A^iooeeC’ 

Afc/ 

-ntAf  Pe^f4>^  fviW  ‘Se»«5«  . 


owTpur 


IF  THt  PSfA  ^e«e  -VO  ^  OF  Ci#^i.fc  Po.*>^  -VO 

^  ^  TOPW^. 

i»-SrtTAO  or  S-r^^v.kKv  TV>ywA*i>s  n«  hS*  l  yju'f:? 

^  To  To<vAW>s  Twe^  c.rf.  Trj?  cxifs.1 


(5^  WV*Ar  TH*  3'"  Oionv,.*,.^  |»a? 


94 


UNCLASSIFIED 


21 

t.- r^ureiU  TCAM 

r  o  I 

S.  t  • 


A  ikt«ry«\_  «vi«^  T*  A»V  offaftjx^mes  {g'vwO'  -»/ 

l»  To  u-oic.  At  THii^AT  •CTfccrioo^ 


95 


UNCLASSIFIED 


(T>  -n!0? 


MBS  APP 


pcj’Ti-^^  »  -t*  »ieM‘-oei  OIL  ■h,4e  £*  (>’/*<*'tT 


*.«L 


A 


>no^W 

e^  A  v  eA>fi 

ir>M^ 


-i  J-  M  1 1 


fle  <ur5<'<3r«ie.'-c-^ 
rai-Ri£j«2-  eAfTi  '. 

TVtfcc..im.y  ^ 
C.f4Ai>J  rvoPITV  i 

‘j^CWiCj  . _ _/ 

aiiu*c  i'’ 

■jUSfl4LCiJ 

^'f. 


*  I! 

Ut 

ts 

L'i 


>  a 


AaviCClL 

fi’iTTATitiJ  l<l\,<~f>  (►OlOtIT' 

/  *  *  P-Atf  TRjjy^a;  Tiur’ 

/  *  rriATv/M-ry* 

/  , 

v-4U\.  xAfttm 

Hi'i'Wl  ACn-i'iy  * 

-ri>  ppret*'  A  ■» 


DyWAMi^  More 


.'?!i 


-ret-u'.«  A.M|IV1AT)C1A>  (RyrATlufMt,v«dtf^ 

-fM«T  te«f«e5ei.T^ 

•  P.l-AA<1AV-  (M^TA^C-lTy 


■»N 


SPT<  \. 
,LV>YWt< 


'  fveivevr 


r  »/se  T»  »..»»>uuBe 

ftji'  <.W»  (Mi- 
vf  fMtWMv  rnCLi  nitv. 

i-**’  -T^"' 

••»IV  4' 


»  A  ■■flt.PA- 
•  Arnj<ATii»J 

Arv  >t/V/* 


N. 


|^-'  -^.irc^c  ,  -Sier  jT<Fi«.r&^  1\' «>4f>.v^? 

0fo  tp 


jrt  ytATPj*if)\5'^|f 
♦  \AAia»’T5 


96 


UNCLASSIFIED 


ty'w/voii 


_ 


Poth^tiAU 

Su#fLie«s 


vts^Av—  '^itr  f’ott'txi  • 


•(  d^coA.  vj. 

Am-watid-^  (cw  '^-'. 

ifsKwCA 

■f  (c^eir  y/.SPuaf*67 

"If-  (^PeAXr  V/.  V»VX4Py^ 

v.A*j'c»2S^<>f'ri^  FK-Teej 


■S<7 
6A<i<--«A«.t 
OC.  OiTT 
pVdiT'  ft»« 

CCov-'i? 


stXVTfe^ 

05-PTU  It-'  a  tf>ii«CT>o»J  9  iWOlCATE-i 

r»«v/CT<F'ja  ^uR.c£3 

Oe^m-^  I«^  (£)  a  t)lflec.Tiur/  if/l?KA‘rc^4. 
ONTAfYCO  5o<l.K<36At^  lV»?V‘?lS2.y 


fVlWWT1#C.C 

n-/ 

rA4VfeD  >€, 


<vt.l>fc5TS 

$l(vOU2  ' 

lX3 


\ 


w/  ^-ft>*^'^/l 
«A5-e  // 


HA^IT  A 

Cv^OvO 


o«\.uTiPO£ 
SowCCCd  V'/ 
•yt^v^ejxt^ 
t-kx 


97 


UNCLASSIFIED 


I® /H  z  30  I  2, 


•«'^Ty 


(?V_AC  V^l'lN'Cy 


UNCLASSIFIED 


Appendix  C 


15 

min/day 

0.25 

hrs/day 

220 

days/yr 

$  50 

$/hr 

$  2,750 

$/yr/analyst 

200 

analysts 

$550,000 

$/yr/pack  of  200  analysts 

20000 

NIINs 

with  1/2  being  DLA  managed 

100 

NIINs/analyst 

11000 

TACOM  suppliers 

55 

suppliers/analyst 

~  1  supplier/week/analyst 

~lhr/suppl 

lier/yr/analyst 

99 


